-- Logs begin at Thu 2022-09-08 19:14:28 UTC, end at Thu 2022-09-08 20:19:53 UTC. -- Sep 08 19:45:27.961028 dv-cinder-831247-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 19:45:27.971490 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 19:45:27 2022] *** Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: nodename: dv-cinder-831247-25-iscsi Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: machine: x86_64 Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: clock source: unix Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: pcre jit disabled Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: detected number of CPU cores: 4 Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: current working directory: / Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: detected binary path: /usr/bin/uwsgi-core Sep 08 19:45:27.973465 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: your processes number limit is 47680 Sep 08 19:45:27.974126 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: your memory page size is 4096 bytes Sep 08 19:45:27.974126 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: detected max file descriptor number: 2048 Sep 08 19:45:27.974126 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: lock engine: pthread robust mutexes Sep 08 19:45:27.974126 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: thunder lock: enabled Sep 08 19:45:27.974126 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 19:45:27.974126 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 19:45:28.015154 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: Python main interpreter initialized at 0x55608a0499c0 Sep 08 19:45:28.015154 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: python threads support enabled Sep 08 19:45:28.015154 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: your server socket listen backlog is limited to 100 connections Sep 08 19:45:28.015154 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: your mercy for graceful operations on workers is 90 seconds Sep 08 19:45:28.015499 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 19:45:28.015499 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: *** Operational MODE: preforking *** Sep 08 19:45:28.015740 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: *** uWSGI is running in multiple interpreter mode *** Sep 08 19:45:28.015740 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: spawned uWSGI master process (pid: 105500) Sep 08 19:45:28.015930 dv-cinder-831247-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 19:45:28.017020 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: spawned uWSGI worker 1 (pid: 105501, cores: 1) Sep 08 19:45:28.017020 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: spawned uWSGI worker 2 (pid: 105502, cores: 1) Sep 08 19:45:28.017020 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 19:45:28.667779 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 19:45:28.668424 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 19:45:29.735211 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:45:29.735211 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: from cryptography.utils import int_from_bytes Sep 08 19:45:29.735880 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:45:29.735880 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: from cryptography.utils import int_from_bytes Sep 08 19:45:29.736165 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:45:29.736165 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Sep 08 19:45:29.736568 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:45:29.736568 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: from cryptography.utils import int_from_bytes Sep 08 19:45:32.178126 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 19:45:32.178720 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 19:45:32.178905 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 19:45:32.179293 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 19:45:32.179550 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 19:45:32.179932 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.180259 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.180576 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.180897 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.181224 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.181353 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 19:45:32.181738 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 19:45:32.181826 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.181826 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.181953 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 19:45:32.182104 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.182337 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 19:45:32.182477 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.182552 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 19:45:32.182741 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.182995 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.183126 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.183319 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.183541 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-25-iscsi {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.183636 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.183722 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.183915 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184007 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184234 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184328 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184538 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184636 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184843 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.184938 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.185151 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.185244 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.185454 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.185548 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.185706 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.185982 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.186469 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.186469 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-25-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.186789 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.186901 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187014 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187125 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187235 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187337 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187445 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187555 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187701 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.187837 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.188014 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.188152 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.188331 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.188424 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.188635 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.188922 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189030 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189227 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189316 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189522 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189617 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-25-iscsi {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189820 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.189916 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.190149 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.190244 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.190452 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.190547 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.190783 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.190967 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191069 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191279 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191373 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191573 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191663 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191894 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.191994 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.192218 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.192324 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-25-iscsi {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.192529 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.192634 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.192851 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.192938 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.193171 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.193264 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.193491 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.193623 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.193812 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.193904 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.194116 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.194210 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.194425 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.194511 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.194758 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.194846 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195078 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195173 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195381 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195481 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195699 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195786 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.195944 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196035 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196255 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196345 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196578 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196670 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196883 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.196975 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.197185 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.197272 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.197448 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.197545 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.197700 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.197791 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198017 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198112 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198302 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198386 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198603 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198713 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.198943 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199040 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199249 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199340 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199556 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199641 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199800 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.199890 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200047 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200144 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200359 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200451 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200668 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200766 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.200971 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.201062 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.201273 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.201357 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.201591 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.201784 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.201920 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202016 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202206 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202299 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202506 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202720 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202840 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.202980 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.203121 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.203287 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.203434 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.203629 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.203741 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.203949 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.204041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.204260 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.204353 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.204581 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.204666 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.204901 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205013 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205209 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205312 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205521 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205613 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205834 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.205931 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.206153 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.206253 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.206451 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.206541 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.206814 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.206951 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207048 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207127 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207325 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207425 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207628 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207723 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.207949 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208058 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208255 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208344 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208562 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208658 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208862 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.208952 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.209108 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.209191 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.209402 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.209485 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.209699 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.209784 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210009 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210092 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210397 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210605 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210723 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.210928 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211014 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211220 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211322 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211517 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211620 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211816 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.211901 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.212115 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.212216 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.212413 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.212500 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.212712 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.212812 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213012 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213116 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213305 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213399 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213601 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213686 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213896 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.213990 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.214192 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.214275 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.214503 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.214588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.214841 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.214945 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.215139 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.215233 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.215436 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.215534 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.215731 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.215829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216028 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216120 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216338 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216425 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216634 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216726 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.216935 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217021 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217262 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217351 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217559 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217651 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217860 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.217950 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.218165 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.218257 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.218462 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.218546 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.218783 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.218870 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219087 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219172 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219380 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219470 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219678 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219769 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.219975 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220058 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220272 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220355 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220566 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220649 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220858 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.220941 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.221152 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.221242 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.221448 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.221538 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.221742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.221843 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.222036 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.222121 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.222331 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.222416 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.222622 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.222793 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.222962 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.223102 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.223342 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.223473 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.223659 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.223755 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.223957 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.224039 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.224259 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.224343 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.224573 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:45:32.224670 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.224903 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.224988 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.225215 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.225298 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.225541 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.225640 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.225858 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.225941 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.226160 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.226249 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.226473 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.226558 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.226815 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.226919 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.227125 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.227209 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.227433 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.227519 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.227752 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.227834 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228056 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228211 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228361 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228447 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228667 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228751 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.228981 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.229073 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.229294 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.229379 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.229614 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.229698 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.229921 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230010 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230230 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230323 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230540 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230632 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230872 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.230974 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.231184 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.231269 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.231504 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.231597 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.231820 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.231914 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.232124 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.232254 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.232456 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.232540 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.232791 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.232912 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.233150 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.233244 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.233462 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.233545 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.233780 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.233897 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.234088 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.234186 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.234395 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.234480 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.234723 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.234825 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235034 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235127 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235347 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235431 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235651 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235817 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.235963 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236047 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236265 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236348 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236579 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236670 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236883 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.236975 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.237185 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.237271 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.237488 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.237573 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.237796 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.237880 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.238100 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.238193 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.238407 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.238489 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.238743 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.238841 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239052 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239150 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239358 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239450 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239659 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239748 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.239965 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240059 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240267 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240350 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240570 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240654 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240872 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.240966 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.241168 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.241304 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.241464 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.241549 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.241758 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.241852 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242060 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242144 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242355 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242440 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242776 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.242997 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243091 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243296 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243386 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243605 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243903 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.243985 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.244206 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.244297 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.244509 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.244601 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.244811 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.244893 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.245105 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.245194 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.245409 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.245495 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.245712 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.245796 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246009 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246101 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246323 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246406 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246624 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246729 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.246949 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247043 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247257 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247353 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247553 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247637 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247859 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.247952 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.248168 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.248253 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.248497 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.248592 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.248806 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.248901 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.249108 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.249200 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.249412 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.249497 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.249726 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.249813 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250030 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250115 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250332 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250424 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250667 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250753 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.250974 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251059 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251278 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251375 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251580 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251672 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251889 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.251980 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.252192 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.252275 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.252490 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.252576 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.252792 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.252876 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253086 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253177 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253383 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253467 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253679 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253763 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.253979 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254071 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254276 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254360 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254572 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254714 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254898 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.254998 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.255192 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.255282 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.255488 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.255572 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.255803 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.255903 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256104 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256195 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256403 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256532 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256700 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256791 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.256997 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.257090 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.257332 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.257424 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.257636 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.257732 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.257967 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.258059 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.258277 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.258360 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.258589 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.258692 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.258926 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.259010 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.259230 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.259322 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.259538 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.259984 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.260194 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.260286 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.260499 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.260593 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.260802 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.260895 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.261102 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.261190 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.261407 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.261498 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.261707 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.261790 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262017 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262101 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262319 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262411 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262632 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262747 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.262955 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263046 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263266 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263363 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263562 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263647 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263867 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.263951 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.264246 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.264333 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.264558 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.264677 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.264869 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.264954 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.265178 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.265262 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.265481 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.265567 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.265788 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.265873 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.266089 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.266174 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.266391 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.266479 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.266716 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.266805 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267018 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267118 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267327 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267410 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267632 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267715 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.267943 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268028 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268244 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268328 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268557 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268656 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268858 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.268949 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.269164 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.269248 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.269459 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.269552 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.269762 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.269854 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.270072 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.270156 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.270379 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.270480 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.270718 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.270805 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271019 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271102 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271335 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271429 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271636 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271727 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.271940 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272025 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272245 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272337 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272542 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272675 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272839 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.272925 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.273143 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.273262 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.273448 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.273538 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.273747 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.273829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.274049 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.274142 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.274368 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.274451 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.274718 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.274807 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275038 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275122 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275340 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275424 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275640 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275737 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.275944 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276029 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276257 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276340 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276561 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276656 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276867 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.276951 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.277173 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.277257 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.277469 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.277559 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.277773 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.277858 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.278090 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.278174 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.278393 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.278486 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.278712 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.278799 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279013 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279113 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279311 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279396 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279634 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279717 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.279965 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280048 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280264 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280349 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280572 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280657 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280878 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.280961 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.281180 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.281264 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.281482 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.281566 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.281785 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.281870 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.282085 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.282171 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.282396 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.282487 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.282722 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.282821 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283026 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283119 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283330 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283421 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283633 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283733 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.283933 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.284066 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.284235 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.284331 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.284547 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.284806 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.284903 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.285135 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.285217 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.285437 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.285529 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.285733 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.285824 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.286033 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.286125 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.286343 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.286437 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.286738 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.286928 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.287069 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.287255 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.287385 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.287569 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.287694 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.287881 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288007 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288214 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288311 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288525 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288651 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288847 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.288946 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.289169 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.289261 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.289476 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.289561 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.289777 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.289870 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.290082 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.290166 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.290381 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.290465 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.290701 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.290790 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291006 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291101 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291301 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291395 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291598 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291685 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291895 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.291988 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.292196 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.292281 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.292493 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.292578 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.292788 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.292872 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293082 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293166 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293376 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293504 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293683 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293768 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.293978 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.294107 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.294280 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.294370 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.294575 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.294674 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.294915 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295014 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295216 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295301 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295562 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295649 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295863 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.295962 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.296159 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.296243 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.296493 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.296579 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.296793 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.296881 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.297123 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.297208 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.297428 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.297510 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.297739 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.297824 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298050 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298134 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298346 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298428 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298664 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298750 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.298968 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299052 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299266 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299351 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299562 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299647 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299862 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.299944 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.300162 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.300258 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.300457 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.300540 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.300759 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.300850 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301059 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301152 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301358 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301441 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301656 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301739 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.301948 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302041 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302253 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302336 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302554 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302683 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302886 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.302987 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.303188 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.303279 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.303503 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.303588 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.303803 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.303896 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304104 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304185 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304402 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304484 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304695 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304780 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.304996 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305079 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305292 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305375 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305600 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305685 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305895 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.305979 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.306189 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.306282 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.306485 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.306570 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.306810 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.306896 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.307110 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.307202 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.307434 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.307525 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.307707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.307797 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308009 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308100 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308303 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308389 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308597 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308681 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308895 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.308988 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.309191 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.309275 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.309484 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.309568 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.309782 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.309917 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.310088 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.310179 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.310392 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.310486 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.310711 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.310798 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311041 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311128 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311340 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311435 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311640 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311726 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.311935 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312018 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312233 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312319 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312528 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312614 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312822 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.312915 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.313116 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.313204 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.313413 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.313510 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.313707 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.313792 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314020 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314117 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314320 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314412 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314615 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314781 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.314936 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315031 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315232 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315318 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315568 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315652 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315864 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.315958 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.316209 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.316293 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.316508 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.316591 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.316817 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.316981 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.317132 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.317216 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.317436 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.317521 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.317741 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.317834 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318047 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318146 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318342 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318427 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318705 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318795 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.318976 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319072 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319283 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319367 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319581 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319674 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319879 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.319972 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.320192 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.320283 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.320499 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.320584 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.320801 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.320887 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.321110 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.321192 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.321421 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.321513 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.321734 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.321816 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322031 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322124 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322334 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322418 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322731 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.322964 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323058 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323273 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323364 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323576 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323661 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323880 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.323973 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.324187 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.324277 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.324489 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.324573 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.324795 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.324887 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.325098 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.325190 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.325402 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.325493 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.325710 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.325802 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.326016 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.326100 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.326314 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.326399 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.326698 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.326788 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327007 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327094 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327392 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327616 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327709 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.327917 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328000 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328223 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328308 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328523 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328609 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328904 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.328994 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.329212 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.329307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.329523 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.329634 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.329823 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.329950 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.330129 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.330272 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.330431 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.330563 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.330775 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.330897 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.331084 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.331202 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.331387 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.331515 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.331796 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.331880 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.332103 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.332196 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.332408 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.332493 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.332711 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.332796 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333010 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333095 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333391 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333612 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333696 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.333930 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.334022 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.334229 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.334336 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.334531 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.334697 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.334854 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.335085 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.335178 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.335399 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.335483 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.335750 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.335854 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.336043 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.336149 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.336367 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.336463 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.336697 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.336803 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337007 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337134 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337328 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337445 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337642 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337749 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.337973 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.338059 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.338302 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.338386 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.338619 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.338721 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.338961 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339054 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339271 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339362 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339573 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339657 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339892 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.339985 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.340207 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.340291 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.340514 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.340597 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.340827 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.340936 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.341130 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.341262 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.341449 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.341577 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.341766 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.341903 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.342076 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.342253 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.342416 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.342561 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.342852 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.342940 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.343172 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.343257 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.343477 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.343574 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.343785 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.343869 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.344101 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.344184 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.344401 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.344495 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.344701 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.344786 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345005 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345090 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345306 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345391 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345608 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345696 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345910 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.345993 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.346210 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.346295 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.346515 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.346600 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.346845 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.346932 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.347149 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.347243 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.347453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.347751 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.347836 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348067 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348153 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348365 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348458 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348678 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348807 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.348980 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349072 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349286 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349371 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349593 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349686 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349891 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.349981 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.350209 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.350295 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.350510 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.350603 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.350842 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.350928 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.351143 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.351230 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.351442 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.351535 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.351779 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.351864 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.352080 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.352165 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.352395 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.352481 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.352721 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.352806 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353039 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353122 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353343 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353473 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353658 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353743 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.353966 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.354097 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.354277 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.354362 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.354582 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.354696 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.354915 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355008 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355222 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355524 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355607 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355824 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.355985 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.356127 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.356212 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.356424 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.356508 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.356723 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.356822 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357020 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357106 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357324 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357409 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357629 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357723 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.357977 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358065 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358281 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358586 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358715 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358911 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.358995 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.359226 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.359311 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.359527 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.359613 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.359824 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.359911 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.360123 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.360208 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.360417 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.360503 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.360753 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.360846 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361053 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361146 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361373 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361458 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361683 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361768 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.361991 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.362084 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.362299 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.362384 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.362606 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.362719 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.362941 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.363103 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.363251 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.363336 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.363560 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.363644 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.363869 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.364075 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.364204 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.364407 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.364494 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.364727 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.364856 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365044 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365140 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365353 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365445 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365674 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365863 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.365992 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.366189 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.366305 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.366498 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.366620 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.366832 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.366953 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.367139 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.367266 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.367452 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.367593 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.367761 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.367917 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368067 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368371 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368576 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368683 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368893 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.368979 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.369221 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.369307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.369540 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.369626 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.369857 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.369942 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.370188 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.370272 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.370498 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.370597 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.370836 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.370932 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.371143 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.371235 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.371451 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.371536 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.371766 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.371858 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372080 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372178 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372381 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372467 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372689 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372773 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.372998 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.373083 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.373304 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.373387 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.373633 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.373721 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.373939 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374061 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374245 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374330 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374550 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374672 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374877 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.374964 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.375179 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.375272 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.375522 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.375623 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.375838 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.375924 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.376151 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.376235 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.376480 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.376666 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.376792 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.376982 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.377098 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.377317 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.377402 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.377645 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.377785 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.377971 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.378201 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.378286 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.378508 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.378607 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.378859 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.378945 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.379177 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.379261 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.379492 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.379579 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.379800 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.379884 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.380111 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.380202 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.380416 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.380507 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.380716 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.380799 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381013 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381098 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381317 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381410 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381620 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381713 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.381918 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.382003 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.382233 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.382453 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.382545 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.382823 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.382913 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.383144 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.383237 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.383443 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.383527 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.383785 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.383966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.384107 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.384308 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.384416 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.384967 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.385098 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.385295 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.385393 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.385615 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.385701 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.385929 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386022 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386233 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386319 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386554 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386660 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386880 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.386975 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.387182 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.387268 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.387498 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.387583 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.387802 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.387885 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.388098 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.388192 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.388398 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.388483 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.388702 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.388787 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389004 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389109 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389363 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389456 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389671 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389765 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.389990 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.390082 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.390296 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.390392 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.390601 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.390725 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.390931 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391023 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391232 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391318 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391540 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391641 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391839 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.391925 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.392137 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.392221 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.392435 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.392599 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.392734 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.392820 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393039 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393125 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393338 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393432 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393639 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393724 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.393941 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.394029 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.394244 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.394331 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.394558 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.394685 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.394904 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395005 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395199 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395290 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395516 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395602 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395815 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.395900 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.396113 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.396199 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.396421 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.396506 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.396726 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.396810 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.397042 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.397291 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.397376 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.397628 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.397712 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.397950 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.398035 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.398271 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.398353 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.398604 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.398818 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.398938 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.399143 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.399237 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.399460 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.399545 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.399788 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.399881 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.400112 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.400199 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.400413 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.400499 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.400714 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.400801 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401012 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401098 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401332 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401425 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401636 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401721 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.401942 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.402027 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.402247 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.402333 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.402551 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.402693 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.402885 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403022 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403195 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403280 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403504 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403589 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403811 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.403929 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.404114 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.404209 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.404418 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.404503 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.404742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.404831 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405044 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405142 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405345 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405465 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405647 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405732 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.405954 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.406049 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.406284 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.406369 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.406592 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.406694 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.406929 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407017 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407235 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407322 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407550 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407641 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407849 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.407935 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.408151 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.408241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.408452 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.408537 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.408752 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409063 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409147 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409383 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409470 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409777 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.409985 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.410071 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.410314 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.410620 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.410749 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.410954 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411040 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411267 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411353 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411582 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411685 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411886 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.411972 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.412202 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.412287 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.412518 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.412604 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.412822 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.412907 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.413138 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.413223 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.413441 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.413527 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.413751 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.413834 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.414059 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.414144 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.414372 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.414458 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.414725 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.414815 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415019 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415115 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415319 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415406 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415619 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415704 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.415920 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416018 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416223 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416523 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416606 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416819 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.416914 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.417115 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.417200 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.417421 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.417504 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.417717 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.417809 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418011 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418095 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418307 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418391 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418604 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418720 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.418928 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419012 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419221 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419304 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419515 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419603 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419810 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.419902 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.420103 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.420189 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.420445 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.420535 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.420744 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.420830 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421046 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421130 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421340 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421426 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421637 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421723 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.421934 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422028 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422232 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422317 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422535 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422620 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422885 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.422987 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.423211 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.423297 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.423518 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.423603 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.423831 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.423930 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.424136 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.424222 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.424444 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.424534 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.424741 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.424833 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425053 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425138 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425367 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425451 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425669 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425754 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.425971 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.426063 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.426280 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.426364 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.426582 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.426695 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.426923 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427010 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427227 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427312 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427536 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427629 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427836 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.427930 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.428182 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.428327 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.428454 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.428539 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.428768 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.428887 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429062 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429155 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429378 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429470 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429687 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429779 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.429997 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.430090 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.430303 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.430388 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.430604 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.430737 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.430937 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431030 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431238 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431328 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431540 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431633 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431848 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.431941 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.432149 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.432240 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.432452 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.432545 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.432760 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.432845 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433061 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433147 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433362 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433461 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433670 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433755 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.433977 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.434068 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.434293 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.434392 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.434609 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.434755 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.434987 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.435071 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.435308 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.435402 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.435623 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.435715 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.435954 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.436046 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.436265 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.436360 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.436511 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 19:45:32.436596 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.436903 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.437209 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.437517 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.437814 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:45:32.438050 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 19:45:32.591990 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Registered counter for database nova_api Sep 08 19:45:32.594126 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Registered counter for database nova_api Sep 08 19:45:32.613422 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.615431 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.620412 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.622057 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.678607 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.context [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5aa0669-26cf-4d36-ab88-a2a225f92acd(cell1) {{(pid=105501) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 19:45:32.679332 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.context [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5aa0669-26cf-4d36-ab88-a2a225f92acd(cell1) {{(pid=105502) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 19:45:32.683050 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:45:32.683357 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:45:32.683508 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:45:32.683827 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:45:32.685065 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:45:32.685399 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:45:32.685763 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:45:32.686143 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:45:32.686278 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:45:32.686606 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:45:32.688220 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:45:32.688598 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_concurrency.lockutils [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:45:32.690238 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Registered counter for database nova_cell0 Sep 08 19:45:32.690617 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Registered counter for database nova_cell0 Sep 08 19:45:32.694394 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Registered counter for database nova_cell1 Sep 08 19:45:32.694631 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Registered counter for database nova_cell1 Sep 08 19:45:32.702373 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.703785 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.705895 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.709706 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.709832 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.712282 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.715423 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.851772 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.857121 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO dbcounter [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Registered counter for database nova_cell0 Sep 08 19:45:32.861035 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO dbcounter [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Registered counter for database nova_cell0 Sep 08 19:45:32.866755 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_db.sqlalchemy.engines [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.870192 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG oslo_db.sqlalchemy.engines [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:45:32.872339 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writer thread running {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:32.875084 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writer thread running {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:45:33.208964 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:45:33.211297 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:45:33.216287 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:45:33.218559 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:45:33.567144 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:45:33.570993 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:45:33.573067 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: WARNING keystonemiddleware.auth_token [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:45:33.577118 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: WARNING keystonemiddleware.auth_token [None req-5348dfe6-ea27-45c5-b95e-b3038316706d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:45:33.578422 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55608a0499c0 pid: 105501 (default app) Sep 08 19:45:33.580539 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:45:33.581719 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Sep 08 19:45:33.582145 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Thu Sep 8 19:45:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:45:33.582761 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55608a0499c0 pid: 105502 (default app) Sep 08 19:46:54.536139 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:46:54.537369 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Sep 08 19:46:54.537919 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:46:54.550345 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:54.551504 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:54.552632 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell1:SELECT=3 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:54.554625 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:55.517403 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-61f7037d-423f-4eaf-92f0-44c49547025a admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:46:55.550973 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-61f7037d-423f-4eaf-92f0-44c49547025a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.005783 Sep 08 19:46:55.553073 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1292 bytes} [Thu Sep 8 19:46:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:46:58.132185 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:46:58.133542 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-306a4f3e-1745-4594-a086-1b5c0479fef2 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001900 Sep 08 19:46:58.134507 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:46:58.606264 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b84adedc-1f48-4ce6-bba5-4fbf819ab0ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "vcpus": 1}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:46:58.655886 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-b84adedc-1f48-4ce6-bba5-4fbf819ab0ca admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.515042 Sep 08 19:46:58.656492 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:46:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 19:46:58.670167 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:58.671004 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell1:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:58.673835 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=3 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:58.674579 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:46:58.895737 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-de09fd82-3911-4123-90ca-eae98aa11e91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:46:58.962820 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-de09fd82-3911-4123-90ca-eae98aa11e91 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297988 Sep 08 19:46:58.963414 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1336 bytes} [Thu Sep 8 19:46:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:01.547983 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b84adedc-1f48-4ce6-bba5-4fbf819ab0ca admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:01.549056 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-b84adedc-1f48-4ce6-bba5-4fbf819ab0ca admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Sep 08 19:47:01.549613 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:02.235133 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-a6c82aa5-0ff3-4edd-b503-2c9e04b48133 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 5}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:02.278896 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-a6c82aa5-0ff3-4edd-b503-2c9e04b48133 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.722599 Sep 08 19:47:02.282722 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:02.292610 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-82a0ce0e-3097-4a86-97db-a0f636ea55c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:02.339091 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-82a0ce0e-3097-4a86-97db-a0f636ea55c2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050327 Sep 08 19:47:02.340533 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1336 bytes} [Thu Sep 8 19:47:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:04.913789 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-a6c82aa5-0ff3-4edd-b503-2c9e04b48133 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:04.914843 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-a6c82aa5-0ff3-4edd-b503-2c9e04b48133 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 08 19:47:04.915233 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:05.324683 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-8fa2240f-c8cb-4f63-97a0-48ed53442046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "swap": 0, "ram": 1024}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:05.346289 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-8fa2240f-c8cb-4f63-97a0-48ed53442046 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.424958 Sep 08 19:47:05.346854 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 19:47:05.362721 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-bd8c75f3-88e6-487d-ac02-8e465f7fb6a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:05.392880 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-bd8c75f3-88e6-487d-ac02-8e465f7fb6a3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034475 Sep 08 19:47:05.393470 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1336 bytes} [Thu Sep 8 19:47:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:07.987721 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-8fa2240f-c8cb-4f63-97a0-48ed53442046 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:07.988753 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-8fa2240f-c8cb-4f63-97a0-48ed53442046 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 08 19:47:07.989122 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:08.406384 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-acbfd61a-3c80-4636-af0d-35ac3bc11938 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:08.425919 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-acbfd61a-3c80-4636-af0d-35ac3bc11938 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430278 Sep 08 19:47:08.430719 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:08.439302 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-88a00421-ae40-4fe8-a9f8-35648e07398f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:08.467362 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-88a00421-ae40-4fe8-a9f8-35648e07398f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032273 Sep 08 19:47:08.468239 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1336 bytes} [Thu Sep 8 19:47:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:47:11.047103 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-acbfd61a-3c80-4636-af0d-35ac3bc11938 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:11.048153 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-acbfd61a-3c80-4636-af0d-35ac3bc11938 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Sep 08 19:47:11.048583 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:11.483039 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6a2bcaee-987a-4f60-a746-6e8fc82cf5fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "vcpus": 4, "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:11.504755 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6a2bcaee-987a-4f60-a746-6e8fc82cf5fb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449365 Sep 08 19:47:11.505421 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:11.518586 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-55f2186b-da30-4d5e-97d0-b4e43dd672e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:11.544805 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-55f2186b-da30-4d5e-97d0-b4e43dd672e5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030110 Sep 08 19:47:11.545406 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1336 bytes} [Thu Sep 8 19:47:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:14.135209 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6a2bcaee-987a-4f60-a746-6e8fc82cf5fb admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:14.137131 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6a2bcaee-987a-4f60-a746-6e8fc82cf5fb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Sep 08 19:47:14.137607 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:14.561946 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-edb74571-3149-40fa-b209-d452ea1f5a5b admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:14.588163 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-edb74571-3149-40fa-b209-d452ea1f5a5b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444186 Sep 08 19:47:14.589018 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1292 bytes} [Thu Sep 8 19:47:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:17.162132 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-6a2bcaee-987a-4f60-a746-6e8fc82cf5fb admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:17.163200 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-6a2bcaee-987a-4f60-a746-6e8fc82cf5fb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 08 19:47:17.163788 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:17.571273 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-ff9f2f42-4183-495c-a890-9d6a6e9d850b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:17.593298 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-ff9f2f42-4183-495c-a890-9d6a6e9d850b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.423578 Sep 08 19:47:17.593835 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:17.606050 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b2f17858-1988-4f17-bf95-f4e56534cfbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:17.634743 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-b2f17858-1988-4f17-bf95-f4e56534cfbb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032478 Sep 08 19:47:17.635326 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1333 bytes} [Thu Sep 8 19:47:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:47:20.192196 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-ff9f2f42-4183-495c-a890-9d6a6e9d850b admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:20.193264 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-ff9f2f42-4183-495c-a890-9d6a6e9d850b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 08 19:47:20.193669 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:20.566560 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-f67e7f04-08af-4e1e-b835-ce11b8a637b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "2", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:20.586519 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-f67e7f04-08af-4e1e-b835-ce11b8a637b8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.386735 Sep 08 19:47:20.587113 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:20.600382 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-d87ed67a-6ccd-484a-a16b-136d63d0fd27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:20.624309 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-d87ed67a-6ccd-484a-a16b-136d63d0fd27 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028366 Sep 08 19:47:20.624900 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1333 bytes} [Thu Sep 8 19:47:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:23.226050 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-f67e7f04-08af-4e1e-b835-ce11b8a637b8 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:23.227103 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-f67e7f04-08af-4e1e-b835-ce11b8a637b8 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 08 19:47:23.227692 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:23.663775 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-b53727b3-bb23-4028-b55f-c110b12820ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "vcpus": 2}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:23.683791 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-b53727b3-bb23-4028-b55f-c110b12820ec admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.449547 Sep 08 19:47:23.684959 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:23.696980 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bd3a7a04-2ce6-4daf-94fe-7ad90dfd5d4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:23.728703 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-bd3a7a04-2ce6-4daf-94fe-7ad90dfd5d4b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035412 Sep 08 19:47:23.729334 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1333 bytes} [Thu Sep 8 19:47:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:26.325605 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-b53727b3-bb23-4028-b55f-c110b12820ec admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:26.327332 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-b53727b3-bb23-4028-b55f-c110b12820ec admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002287 Sep 08 19:47:26.327889 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:26.783893 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-fe91c0e1-d102-4fa6-9e83-16f9ecb3ba63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:26.791903 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:47:26.808638 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-fe91c0e1-d102-4fa6-9e83-16f9ecb3ba63 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474560 Sep 08 19:47:26.809368 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 19:47:26.821486 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-ae25103d-46ac-4255-b4f4-fb4861dd50f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:26.854356 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-ae25103d-46ac-4255-b4f4-fb4861dd50f1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036434 Sep 08 19:47:26.871176 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1333 bytes} [Thu Sep 8 19:47:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:47:29.446431 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-fe91c0e1-d102-4fa6-9e83-16f9ecb3ba63 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:29.447483 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-fe91c0e1-d102-4fa6-9e83-16f9ecb3ba63 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 08 19:47:29.447882 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:29.894201 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-962991e1-0724-4199-b15d-c6cdb031e6ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:29.903589 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:47:29.917038 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-962991e1-0724-4199-b15d-c6cdb031e6ac admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463280 Sep 08 19:47:29.917685 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1283 bytes} [Thu Sep 8 19:47:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:29.930333 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-259d065d-6af9-41a7-8ba4-72b2e4229867 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:29.956954 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-259d065d-6af9-41a7-8ba4-72b2e4229867 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030206 Sep 08 19:47:29.970670 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1333 bytes} [Thu Sep 8 19:47:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:47:47.085033 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-962991e1-0724-4199-b15d-c6cdb031e6ac admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:47.086043 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-962991e1-0724-4199-b15d-c6cdb031e6ac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 08 19:47:47.086462 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:47.103954 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:47:47.531848 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-3d11ec19-8253-47cd-b8f2-1a0d845cdaca admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:47.558581 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-3d11ec19-8253-47cd-b8f2-1a0d845cdaca admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.461796 Sep 08 19:47:47.559279 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1292 bytes} [Thu Sep 8 19:47:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:48.895411 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-962991e1-0724-4199-b15d-c6cdb031e6ac admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:48.896438 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-962991e1-0724-4199-b15d-c6cdb031e6ac admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 08 19:47:48.896842 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:49.456310 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b6a7fe51-bb3a-4fd2-ba2a-83b4944e87d2 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:49.464706 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-b6a7fe51-bb3a-4fd2-ba2a-83b4944e87d2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b6a7fe51-bb3a-4fd2-ba2a-83b4944e87d2 admin admin] Request method failure captured: Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Accept: application/json Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Connection: keep-alive Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Content-Length: 0 Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Host: 10.222.0.44 Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.92 Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABjGkbkR9sp5Ne8ybDo40vgr9bhrjKUXlGWY5XHP5D27CyE6LLkc8x12KxdnqJ_MUHYK4_4mH1tI-K50cGFvcyCKYyTtQNHWBe65oqrbSK4H7Ja_5VDOh4_kkayWZYIttYTomUs6JowcYv2zJqjrFiu3m6rR57kGmnXl9af-olnhNi9usI Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Role: reader,admin,member Sep 08 19:47:49.469898 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Roles: reader,admin,member Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf46227e433b40ceba39339e58842b92", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant: admin Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User: admin Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Id: a17efddeb27a450a8695d7f2091f127e Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Name: admin Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: method: > Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: exception: Flavor 42 could not be found. Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: action_args: {'id': '42'} Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:47:49.471501 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:49.472453 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.473688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-b6a7fe51-bb3a-4fd2-ba2a-83b4944e87d2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:47:49.475067 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-b6a7fe51-bb3a-4fd2-ba2a-83b4944e87d2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.436748 Sep 08 19:47:49.475067 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Sep 8 19:47:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 19:47:49.482819 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-82aa029b-4f8d-4895-b059-52476675aec0 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:49.505131 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-82aa029b-4f8d-4895-b059-52476675aec0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026405 Sep 08 19:47:49.505685 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Sep 8 19:47:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:49.517476 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-da4a6913-1f4a-43e4-be9f-84f4e18d6cd3 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:49.539399 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-da4a6913-1f4a-43e4-be9f-84f4e18d6cd3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026778 Sep 08 19:47:49.539929 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Sep 8 19:47:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:49.550165 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4d5754a2-a69a-4c3a-9a3e-42befe217850 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:49.555971 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-4d5754a2-a69a-4c3a-9a3e-42befe217850 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4d5754a2-a69a-4c3a-9a3e-42befe217850 admin admin] Request method failure captured: Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Host: 10.222.0.44 Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjGkbkR9sp5Ne8ybDo40vgr9bhrjKUXlGWY5XHP5D27CyE6LLkc8x12KxdnqJ_MUHYK4_4mH1tI-K50cGFvcyCKYyTtQNHWBe65oqrbSK4H7Ja_5VDOh4_kkayWZYIttYTomUs6JowcYv2zJqjrFiu3m6rR57kGmnXl9af-olnhNi9usI Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Role: reader,admin,member Sep 08 19:47:49.559241 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Roles: reader,admin,member Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf46227e433b40ceba39339e58842b92", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User: admin Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Id: a17efddeb27a450a8695d7f2091f127e Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: method: > Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: exception: Flavor 42 could not be found. Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: action_args: {'id': '42'} Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:47:49.560707 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:49.561676 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:49.562933 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4d5754a2-a69a-4c3a-9a3e-42befe217850 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:47:49.564210 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-4d5754a2-a69a-4c3a-9a3e-42befe217850 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014596 Sep 08 19:47:49.564210 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Sep 8 19:47:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 19:47:50.798251 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-da4a6913-1f4a-43e4-be9f-84f4e18d6cd3 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:50.799332 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-da4a6913-1f4a-43e4-be9f-84f4e18d6cd3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 08 19:47:50.799720 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:51.344347 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-60679c4e-1d72-4ab4-b70d-d0ae79f6f0ac admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:51.349581 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-60679c4e-1d72-4ab4-b70d-d0ae79f6f0ac admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-60679c4e-1d72-4ab4-b70d-d0ae79f6f0ac admin admin] Request method failure captured: Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Host: 10.222.0.44 Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjGkbmWIdsNmreDc7FHOtz3WGAgDtR8gvBp2DG71UV7-ICqpLrN_BJGVzn8Qxtk14z-HPS9vsvDea8_t6-YgKm_0rvjjNkzZLJ-g6QY6zJDqeSXfGWbxzAI_IbXLV2aRK_UrwD2D4ULhsRxv4-gqqHUYwQuIBYVSfP0JlpoRDPBT6-i6M Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Role: reader,admin,member Sep 08 19:47:51.351135 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Roles: reader,admin,member Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf46227e433b40ceba39339e58842b92", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User: admin Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Id: a17efddeb27a450a8695d7f2091f127e Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: method: > Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: exception: Flavor 84 could not be found. Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: action_args: {'id': '84'} Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:47:51.352588 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:51.353366 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.354400 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-60679c4e-1d72-4ab4-b70d-d0ae79f6f0ac admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:47:51.355407 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-60679c4e-1d72-4ab4-b70d-d0ae79f6f0ac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.414856 Sep 08 19:47:51.355407 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Sep 8 19:47:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 19:47:51.362771 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-1e1fa290-10a1-4795-892a-ebf49919199b admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:51.377871 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-1e1fa290-10a1-4795-892a-ebf49919199b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018794 Sep 08 19:47:51.378409 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Sep 8 19:47:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:51.393134 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-cac0c3da-68f6-4be8-9b10-681e3bb48c5c admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:51.413603 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-cac0c3da-68f6-4be8-9b10-681e3bb48c5c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026076 Sep 08 19:47:51.414159 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Sep 8 19:47:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:51.423476 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0bbee61c-dd5f-4db9-bd1e-2d4220303693 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:51.428437 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-0bbee61c-dd5f-4db9-bd1e-2d4220303693 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0bbee61c-dd5f-4db9-bd1e-2d4220303693 admin admin] Request method failure captured: Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Accept: application/json Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Connection: keep-alive Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Content-Length: 0 Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Host: 10.222.0.44 Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.92 Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABjGkbmWIdsNmreDc7FHOtz3WGAgDtR8gvBp2DG71UV7-ICqpLrN_BJGVzn8Qxtk14z-HPS9vsvDea8_t6-YgKm_0rvjjNkzZLJ-g6QY6zJDqeSXfGWbxzAI_IbXLV2aRK_UrwD2D4ULhsRxv4-gqqHUYwQuIBYVSfP0JlpoRDPBT6-i6M Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Role: reader,admin,member Sep 08 19:47:51.429966 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Roles: reader,admin,member Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf46227e433b40ceba39339e58842b92", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant: admin Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User: admin Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Id: a17efddeb27a450a8695d7f2091f127e Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Name: admin Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: method: > Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: exception: Flavor 84 could not be found. Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: action_args: {'id': '84'} Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:47:51.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:51.432742 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:51.434041 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-0bbee61c-dd5f-4db9-bd1e-2d4220303693 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:47:51.435289 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-0bbee61c-dd5f-4db9-bd1e-2d4220303693 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011455 Sep 08 19:47:51.435289 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Sep 8 19:47:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 19:47:52.663750 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-cac0c3da-68f6-4be8-9b10-681e3bb48c5c admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:52.664759 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-cac0c3da-68f6-4be8-9b10-681e3bb48c5c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 08 19:47:52.665152 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:53.223958 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bec95790-28e4-4bda-8769-69a60d53f4cc admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:53.230199 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.wsgi [None req-bec95790-28e4-4bda-8769-69a60d53f4cc admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bec95790-28e4-4bda-8769-69a60d53f4cc admin admin] Request method failure captured: Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Accept: application/json Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Accept-Encoding: gzip, deflate Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Connection: keep-alive Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Content-Length: 0 Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Host: 10.222.0.44 Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Openstack-Api-Version: compute 2.92 Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Openstack-System-Scope: None Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: User-Agent: python-novaclient Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Auth-Token: gAAAAABjGkbowJUwEuIy7FpjdS5twAI3DwON0XmeLJnXww2g3F43aG3g1syf733o-wJDRUWMrEj6h5pQUU7NorOUMlCSJ6bZN3pVXKSMddCV_aA_JJ_YzoKvCWwqAGscwMX9x6XmIog8gTVIT-ACcoSjwRaKSC0m0fK0tFgQoR46C8eyOHKmigM Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Domain-Id: None Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Domain-Name: None Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Identity-Status: Confirmed Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Is-Admin-Project: True Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Domain-Id: default Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Domain-Name: Default Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Project-Name: admin Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Role: reader,admin,member Sep 08 19:47:53.231764 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Roles: reader,admin,member Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf46227e433b40ceba39339e58842b92", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant: admin Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-Tenant-Name: admin Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User: admin Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Domain-Id: default Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Domain-Name: Default Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Id: a17efddeb27a450a8695d7f2091f127e Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: X-User-Name: admin Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: method: > Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: exception: Flavor 451 could not be found. Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: action_args: {'id': '451'} Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:47:53.233241 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:53.234260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.235969 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-bec95790-28e4-4bda-8769-69a60d53f4cc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:47:53.237205 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-bec95790-28e4-4bda-8769-69a60d53f4cc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.433679 Sep 08 19:47:53.237205 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Sep 8 19:47:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 19:47:53.243173 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6b99ac7f-1c05-4daf-8f68-aaafd942dda2 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:53.258735 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-6b99ac7f-1c05-4daf-8f68-aaafd942dda2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018726 Sep 08 19:47:53.259373 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Sep 8 19:47:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:53.269698 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:53.284688 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018660 Sep 08 19:47:53.285217 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Sep 8 19:47:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:47:53.294523 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6c9913d1-b1bb-446f-bb6e-a392f5b0b7dd admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:53.299758 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.wsgi [None req-6c9913d1-b1bb-446f-bb6e-a392f5b0b7dd admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6c9913d1-b1bb-446f-bb6e-a392f5b0b7dd admin admin] Request method failure captured: Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Accept: application/json Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Accept-Encoding: gzip, deflate Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Connection: keep-alive Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Content-Length: 0 Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Host: 10.222.0.44 Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Openstack-Api-Version: compute 2.92 Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Openstack-System-Scope: None Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: User-Agent: python-novaclient Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Auth-Token: gAAAAABjGkbowJUwEuIy7FpjdS5twAI3DwON0XmeLJnXww2g3F43aG3g1syf733o-wJDRUWMrEj6h5pQUU7NorOUMlCSJ6bZN3pVXKSMddCV_aA_JJ_YzoKvCWwqAGscwMX9x6XmIog8gTVIT-ACcoSjwRaKSC0m0fK0tFgQoR46C8eyOHKmigM Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Domain-Id: None Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Domain-Name: None Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Identity-Status: Confirmed Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Is-Admin-Project: True Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Domain-Id: default Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Domain-Name: Default Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Project-Name: admin Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Role: reader,admin,member Sep 08 19:47:53.301263 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Roles: reader,admin,member Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cf46227e433b40ceba39339e58842b92", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cf46227e433b40ceba39339e58842b92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant: admin Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant-Id: cf46227e433b40ceba39339e58842b92 Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-Tenant-Name: admin Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User: admin Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Domain-Id: default Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Domain-Name: Default Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Id: a17efddeb27a450a8695d7f2091f127e Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: X-User-Name: admin Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: method: > Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: exception: Flavor 451 could not be found. Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: action_args: {'id': '451'} Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:47:53.302855 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:53.303800 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: ERROR nova.api.openstack.wsgi Sep 08 19:47:53.304829 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-6c9913d1-b1bb-446f-bb6e-a392f5b0b7dd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105501) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:47:53.305792 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-6c9913d1-b1bb-446f-bb6e-a392f5b0b7dd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011627 Sep 08 19:47:53.305792 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Sep 8 19:47:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 19:47:54.535962 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:54.536974 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 08 19:47:54.537372 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:55.115985 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-fed8ef3c-1726-4513-b04a-8ea8aa0c9f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:55.142431 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-fed8ef3c-1726-4513-b04a-8ea8aa0c9f0c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.467336 Sep 08 19:47:55.142991 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Sep 8 19:47:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:56.371598 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:56.372605 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 08 19:47:56.373001 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:56.936954 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-7f498847-abc3-4007-a57b-1edee525e3a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:56.958455 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-7f498847-abc3-4007-a57b-1edee525e3a6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.449072 Sep 08 19:47:56.959021 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Sep 8 19:47:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:58.190859 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:58.191864 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 08 19:47:58.192255 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:47:58.734851 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-d2585c83-ad29-443a-a60e-5c37947551bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:47:58.755186 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-d2585c83-ad29-443a-a60e-5c37947551bb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.428217 Sep 08 19:47:58.755732 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Sep 8 19:47:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:47:59.990682 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:47:59.991710 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 08 19:47:59.992103 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:47:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:48:00.557443 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-16e529ae-4abf-4205-93ee-ff40ba836809 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:48:00.577178 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-16e529ae-4abf-4205-93ee-ff40ba836809 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.438635 Sep 08 19:48:00.577716 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Sep 8 19:48:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:48:01.797547 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:01.798565 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 08 19:48:01.799125 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:48:02.345311 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-65f7285a-dd06-488f-8d06-bcf73160c60d admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:02.365663 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-65f7285a-dd06-488f-8d06-bcf73160c60d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.429731 Sep 08 19:48:02.366186 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Thu Sep 8 19:48:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:48:59.216981 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:59.218690 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-a9f41b8a-bf68-4e2e-b3b0-1134a094a10d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002296 Sep 08 19:48:59.219337 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 931 bytes} [Thu Sep 8 19:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:48:59.233420 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:48:59.646665 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-5293264b-148e-4ec9-b0f0-49b24c58d100 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:59.666969 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-5293264b-148e-4ec9-b0f0-49b24c58d100 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441088 Sep 08 19:48:59.667482 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1292 bytes} [Thu Sep 8 19:48:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:48:59.688368 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=14 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:48:59.692260 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-efaf238d-4abd-423a-912a-79225f71b562 admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:59.700320 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-efaf238d-4abd-423a-912a-79225f71b562 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013349 Sep 08 19:48:59.700857 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1283 bytes} [Thu Sep 8 19:48:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:48:59.714994 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-83654443-7342-4b7e-962c-eecbfc3b4038 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:59.724587 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-83654443-7342-4b7e-962c-eecbfc3b4038 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015287 Sep 08 19:48:59.725110 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1286 bytes} [Thu Sep 8 19:48:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:48:59.736931 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:59.744400 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011121 Sep 08 19:48:59.744932 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1286 bytes} [Thu Sep 8 19:48:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:48:59.757065 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-4ab9fb73-cae1-471a-8423-01bc5947dc01 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:48:59.764455 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-4ab9fb73-cae1-471a-8423-01bc5947dc01 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011410 Sep 08 19:48:59.764971 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1283 bytes} [Thu Sep 8 19:48:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:51:52.504682 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:51:52.505666 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 Sep 08 19:51:52.506060 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:51:52.644686 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=6 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:51:52.824621 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:51:52.829824 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:51:52.830294 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:51:52.830745 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:51:52.831450 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:51:52.831891 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:51:52.832273 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:51:52.863419 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-545ef087-7061-41f5-b48b-dbeac337ae0d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.220788 Sep 08 19:51:52.863960 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Sep 8 19:51:52 2022] GET /compute/v2.1/os-services => generated 794 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:51:53.943899 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:51:53.944910 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 08 19:51:53.945331 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:51:54.137146 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:51:54.140742 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:51:54.141219 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:51:54.141643 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:51:54.142347 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:51:54.142824 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:51:54.143237 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:51:54.162286 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-fd247f66-2615-4cde-9f1e-2ec1a4676cfb admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.078023 Sep 08 19:51:54.162851 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Sep 8 19:51:54 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 19:52:05.699226 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:52:05.700263 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 08 19:52:05.700661 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:52:05.843471 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell0:SELECT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:52:05.844190 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_cell1:SELECT=4 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:52:05.844819 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG dbcounter [-] [105501] Writing DB stats nova_api:SELECT=8 {{(pid=105501) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:52:05.895307 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:52:05.898750 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:52:05.899225 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:52:05.899651 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:52:05.900356 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:52:05.900802 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:52:05.901213 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:52:05.925833 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-08c577c0-f268-4fe8-83f9-6f69a1145712 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.086874 Sep 08 19:52:05.926376 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Sep 8 19:52:05 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:52:07.007867 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG nova.api.openstack.wsgi [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] Calling method '>' {{(pid=105502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:52:07.008868 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: INFO nova.api.openstack.requestlog [None req-16f5cb2b-677a-40b1-94b8-cb369ee6457f admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 08 19:52:07.009261 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: [pid: 105502|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Sep 8 19:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:52:07.212641 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG nova.api.openstack.wsgi [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Calling method '>' {{(pid=105501) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:52:07.215970 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:52:07.216450 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:52:07.216874 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:52:07.217574 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:52:07.218013 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:52:07.218425 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: DEBUG oslo_concurrency.lockutils [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105501) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:52:07.239714 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: INFO nova.api.openstack.requestlog [None req-2d807954-5dc5-4fda-ba1c-3930411ea2f4 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.094066 Sep 08 19:52:07.240251 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: [pid: 105501|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Sep 8 19:52:07 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 19:53:02.779665 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: Thu Sep 8 19:53:02 2022 - graceful shutdown triggered... Sep 08 19:53:02.780212 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: Gracefully killing worker 2 (pid: 105502)... Sep 08 19:53:02.779766 dv-cinder-831247-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 19:53:02.781114 dv-cinder-831247-25-iscsi devstack@n-api.service[105501]: Gracefully killing worker 1 (pid: 105501)... Sep 08 19:53:02.910682 dv-cinder-831247-25-iscsi devstack@n-api.service[105502]: DEBUG dbcounter [-] [105502] Writing DB stats nova_api:SELECT=4 {{(pid=105502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:03.780863 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: worker 1 buried after 1 seconds Sep 08 19:53:03.780863 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: worker 2 buried after 1 seconds Sep 08 19:53:03.780863 dv-cinder-831247-25-iscsi devstack@n-api.service[105500]: goodbye to uWSGI. Sep 08 19:53:03.782797 dv-cinder-831247-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 19:53:03.783435 dv-cinder-831247-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 19:53:03.786711 dv-cinder-831247-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 19:53:03.797553 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 19:53:03 2022] *** Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: nodename: dv-cinder-831247-25-iscsi Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: machine: x86_64 Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: clock source: unix Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: pcre jit disabled Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: detected number of CPU cores: 4 Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: current working directory: / Sep 08 19:53:03.799570 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: detected binary path: /usr/bin/uwsgi-core Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: your processes number limit is 47680 Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: your memory page size is 4096 bytes Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: detected max file descriptor number: 2048 Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: lock engine: pthread robust mutexes Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: thunder lock: enabled Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 19:53:03.800224 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 19:53:03.838815 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: Python main interpreter initialized at 0x5567559d49c0 Sep 08 19:53:03.838815 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: python threads support enabled Sep 08 19:53:03.838815 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: your server socket listen backlog is limited to 100 connections Sep 08 19:53:03.838815 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: your mercy for graceful operations on workers is 90 seconds Sep 08 19:53:03.839253 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 19:53:03.839253 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: *** Operational MODE: preforking *** Sep 08 19:53:03.839499 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: *** uWSGI is running in multiple interpreter mode *** Sep 08 19:53:03.839499 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: spawned uWSGI master process (pid: 120472) Sep 08 19:53:03.839711 dv-cinder-831247-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 19:53:03.840267 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: spawned uWSGI worker 1 (pid: 120484, cores: 1) Sep 08 19:53:03.845974 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: spawned uWSGI worker 2 (pid: 120485, cores: 1) Sep 08 19:53:03.845974 dv-cinder-831247-25-iscsi devstack@n-api.service[120472]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 19:53:04.499476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 19:53:04.502272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 19:53:05.640350 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:53:05.640350 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: from cryptography.utils import int_from_bytes Sep 08 19:53:05.641057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:53:05.641057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: from cryptography.utils import int_from_bytes Sep 08 19:53:05.641366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:53:05.641366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: from cryptography.utils import int_from_bytes Sep 08 19:53:05.641793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 19:53:05.641793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: from cryptography.utils import int_from_bytes Sep 08 19:53:08.007091 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 19:53:08.007785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 19:53:08.008151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 19:53:08.008252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 19:53:08.008331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 19:53:08.008419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 19:53:08.008513 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 19:53:08.008606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 19:53:08.008692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 19:53:08.008784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 19:53:08.008871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.008964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009541 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009887 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.009992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.010215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.010372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.010523 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.010672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.010861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.010967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.011187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.011298 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.011531 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.011650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.011811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.011957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.012110 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.012282 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-25-iscsi {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.012556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831247-25-iscsi {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.012662 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.012885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.012987 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.013237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.013335 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.013556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.013663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.013863 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.013960 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.014204 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.014307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.014532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.014632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.014874 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.015097 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.015396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.015711 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.015851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.016020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.016171 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.016337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.016491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.016696 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.016879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017704 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.017926 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.018108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.018255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.018441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.018571 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.018780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-25-iscsi {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831247-25-iscsi {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019820 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.019955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.020151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.020367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.020564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.020669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.020881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.020987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.021194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.021304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.021524 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.021636 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.021864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.021966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.022178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.022281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.022511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.022718 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.022879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023190 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023340 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.023914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024806 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.024963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.025108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.025255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.025392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.025537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.025687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.025840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.026042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.026194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.026339 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.026485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.026664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.026849 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027351 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027503 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027641 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027781 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.027922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.028065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.028217 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.028356 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.028509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.028652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.028833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.029006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.029247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.029404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.029670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.029831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.030060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.030216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.030370 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.030513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.030701 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.030868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.031016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.031168 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.032533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.032707 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.032852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.032992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.033145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.033295 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.033445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.033445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.033723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.033723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034782 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.034932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.035097 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.035244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.035382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.035526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.035673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.035987 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.036152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.036300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.036481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.036624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.036762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.036963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.037979 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.038118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.038260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.038260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.038522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.038705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.038865 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.039013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.039157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.039305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.039463 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.039620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.039864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.040940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041091 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.041957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.042242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.042391 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.042546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.042829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.042974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043269 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.043811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.044947 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.045092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.045247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.045391 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.045549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.045765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.045915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046356 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.046973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047403 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047549 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.047998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.048230 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.048385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.048539 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.048693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.048831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.048967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.049110 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.049264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.049409 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.049547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.049708 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.049870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.050930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051517 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.051956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.052103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.052241 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.052385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.052523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.052668 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.052822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.053055 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.053210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.053348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.053492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.053649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.053787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.053932 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.054077 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 19:53:08.054216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.054353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.054504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.054671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.054816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.054964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055249 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055693 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.055966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.056111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.056262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.056399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.056544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.056687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.056832 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057774 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.057929 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.058123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.058274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.058423 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.058569 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.058753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.058895 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059055 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059638 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.059943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.060137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.060290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.060430 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.060575 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.060838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061727 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.061872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062154 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062442 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062752 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.062902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.063057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.063296 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.063447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.063602 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.063741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.063878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064305 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064449 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.064888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065190 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065474 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065611 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.065894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.066040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.066178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.066326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.066471 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.067766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.068580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.068734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.068876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.069894 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070319 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.070836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.071247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.071385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.071530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.071677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.072478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.072807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.072951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.073116 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.073350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.074274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.074660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.074844 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.075955 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.076970 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.077950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078406 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.078786 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.079193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.079352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.079492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.079663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.079809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.079955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.080380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.080380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.080677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.080829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.080967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.081898 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082172 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082462 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.082975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.083121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.083271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.083409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.083568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.083713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.083857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084543 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084686 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.084976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.085120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.085264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.085410 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.085568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.085714 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.085864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086003 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086752 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.086899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087033 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087142 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.087990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088664 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.088999 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089339 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089446 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089558 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089782 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.089888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090351 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.090759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091177 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.091962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092099 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.092965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.093103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.093250 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.094057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.094339 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.094752 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.094951 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.095209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.095669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.095894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.096052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.096198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.096447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.096802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.097149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.097293 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.097478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.097621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.097814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.097958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.098121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.098268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.098446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.098598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.098821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.098977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.099131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.099317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.099461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.099608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.099753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.099890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.100060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.100222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.100382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.100544 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.100706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.100860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101024 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.101972 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.102116 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.102279 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.102431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.102576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.102848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.103009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.103162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.103308 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.103467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.103623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.103848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.104002 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.104154 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.104297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.104456 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.104609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.104754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105012 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105458 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.105913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.106056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.106244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.106403 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.106562 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.106749 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.106921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107230 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107382 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107680 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107824 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.107974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.108126 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.108280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.108442 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.108595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.108748 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.108892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.109060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.109257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.109415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.109628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.109793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.109941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.110093 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.110246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.110390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.110390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.110735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.110885 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.111990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.112143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.112294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.112439 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.112594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.112739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.112893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113180 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113609 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.113907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.114058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.114209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.114365 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.114534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.114758 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.114919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.115172 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.115323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.115468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.115612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.115769 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.115914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116544 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116696 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.116984 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.117136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.117281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.117438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.117590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.117735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.117879 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118328 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118490 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.118989 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.119145 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.119290 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.119434 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.119577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.119730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.119915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.120084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.120239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.120384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.120605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.120761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.120907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.121099 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.121256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.121412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.121586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.121743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.121888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.122040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.122194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.122339 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.122519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.122723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.122875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123183 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123618 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.123936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124526 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.124992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.125137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.125386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.125544 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.125691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.125884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126182 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126335 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.126860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.127178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.127335 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.127843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.127990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.128143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.128143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.128437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.128437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.128721 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.128878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.129035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.129186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.129332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.129581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.129732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.129732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130597 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130597 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.130922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.131206 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.131206 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.131496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.131648 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.131793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.131945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.132098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.132242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.132395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.132540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.132692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.132856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.133962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.134106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.134261 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.134413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.134558 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.134743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.134904 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.135070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.135215 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.135367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.135511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.135897 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.136980 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.137148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.137294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.137446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.137598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.137743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.137886 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.138045 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.138221 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.138368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.138520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.138685 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.138846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139318 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.139929 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.140075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.140226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.140371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.140515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.140738 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.140885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.141977 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.142129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.142275 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.142432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.142585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.142755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.142911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143531 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143683 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143834 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.143979 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.144125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.144282 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.144428 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.144573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.144725 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.144871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.145036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.145194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.145347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.145492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.145643 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.145788 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.146046 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.146211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.146365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.146519 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.146705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.146869 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147344 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147658 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.147968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.148125 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.148378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.148543 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.148698 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.148852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149769 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.149914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.150059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.150211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.150363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.150515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.150690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.150849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151003 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.151918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152070 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152224 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152812 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.152956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.153122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.153275 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.153434 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.153579 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.153732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.153956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.154111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.154270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.154416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.154567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.154736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.154894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155217 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155796 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.155940 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.156203 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.156370 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.156524 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.156677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.156831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.156985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.157143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.157299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.157451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.157596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.157748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.157902 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.158048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.158200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.158352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.158504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.158714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.158883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159030 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159754 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.159907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.160053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.160207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.160352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.160496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.160652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.160826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.161105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.161288 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.161442 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.161600 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.161745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.161891 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.162043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.162188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.162332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.162490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.162673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.163430 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.163598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.163754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.163921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164083 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.164977 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.165125 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.165270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.165413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.165557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.165726 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.165879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.166032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.166211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.166459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.166610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.166835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.166983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.167136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.167281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.167426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.167578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.167734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.167889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.168042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.168196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.168341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.168486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.168657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.168998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.169161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.169307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.169494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.169651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.169797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.169949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.170109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.170262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.170416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.170662 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.170815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.170971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.171116 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.171260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.171426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.171586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.171739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.171893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172355 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.172962 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.173106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.173270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.173426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.173578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.173730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.173884 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.174048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.174201 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.174355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.174501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.174699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.174868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175473 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175783 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.175936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.176098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.176250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.176395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.176646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.176808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.176956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.177117 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.177272 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.177427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.177580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.177739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.177888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178343 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.178980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.179125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.179271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.179425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.179578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.179731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.179877 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180041 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180346 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180493 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180792 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.180936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.181081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.181234 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.181393 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.181550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.181705 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.181851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182321 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.182975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.183130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.183283 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.183429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.183573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.183717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.183870 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184033 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184789 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.184935 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.185178 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.185338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.185492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.185652 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.185797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.185942 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.186104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.186251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.186395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.186548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.186808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.186973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.187129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.187276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.187429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.187589 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.187735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.187880 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188783 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.188936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.189976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.190129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.190274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.190426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.190571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.190759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.190915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.191074 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.191235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.191398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.191555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.191701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.191853 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.192080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.192228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.192380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.192534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.192687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.192846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193756 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.193902 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194683 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.194981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.195135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.195281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.195425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.195578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.195725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.195880 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.196032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.196178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.196337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.196491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.196636 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.196851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197543 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197842 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.197997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.198143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.198297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.198443 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.198698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.198852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199456 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.199899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.200062 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.200215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.200368 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.200520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.200725 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.200878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.201034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.201187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.201348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.201506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.201697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.201847 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202159 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202783 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.202945 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.203092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.203236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.203387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.203548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.203703 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.203849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204318 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204463 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.204919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205661 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.205962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.206114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.206308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.206465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.206610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.206800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.206948 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.207118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.207357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.207513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.207674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.207818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.207969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.208130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.208284 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.208429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.208581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.208734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.208879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.209986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210132 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210785 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.210942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.211263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.211263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.211263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.211719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.211873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.211873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.212166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.212311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.212464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.212616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.212768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.212919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213216 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213531 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213681 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.213833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.214253 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.214399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.214544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.214716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.214866 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215464 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.215919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.216065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.216208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.216390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.216535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.216687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.216842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.217001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.217146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.217308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.217556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.217706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.217859 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218782 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.218930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219073 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.219980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.220126 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.220278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.220494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.220649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.220802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.220802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.221092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.221248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.221416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.221564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.221744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.221894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222201 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222355 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222679 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.222995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.223150 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.223150 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.223451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.223595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.223747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.223891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.224045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.224198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.224343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.224557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.224716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.224890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225661 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225812 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.225966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.226111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.226261 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.226405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.226555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.226786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.226946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.227092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.227289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.227439 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.227599 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.227846 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.227997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.228143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.228287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.228432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.228584 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.228743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.228899 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.229844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.230215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.230361 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.230513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.230676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.230828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.230983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.231129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.231272 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.231449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.231604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.231750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.231918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.232106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.232329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.232497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.232671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.232823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.232998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.233369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.233532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.233689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.233960 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.234120 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.234267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.234411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.234566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.234776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.234937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.235083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.235236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.235389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.235550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.235714 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236788 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.236943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.237097 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.237242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.237396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.237542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.237688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.237841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.238005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.238258 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.238419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.238574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.238743 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.238900 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239642 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239787 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.239943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.240098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.240243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.240396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.240541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.240695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.240850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241474 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.241942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.242089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.242234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.242388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.242542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.242781 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.242951 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.243106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.243256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.243547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.243709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.243923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.244088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.244235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.244392 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.244546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.244762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.244923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.245109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.245260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.245414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.245566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.245744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.245904 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.246074 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.246230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.246377 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.246531 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.246716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.246876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247321 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.247996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.248154 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.248419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.248676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.248676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.248993 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.249148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.249301 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.249455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.249609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.249762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.249914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.250060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.250224 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.250371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.250596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.250790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.250954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.251109 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.251263 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.251408 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.251561 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.251713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.251868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.252015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.252167 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.252333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.252839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.252985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.252985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.253261 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.253414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.253716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.253875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.253875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.254160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.254312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.254467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.254626 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.254806 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.254952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.255107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.255260 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.255405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.255559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.255705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.255856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256147 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.256911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.257062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.257257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.257420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.257566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.257711 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.257863 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.258008 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.258162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.258307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.258555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.258765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.258916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.259069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.259228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.259373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.259518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.259670 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.259816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.260555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.260718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.260873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.261765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.261932 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.262081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.262226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.262379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.262533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.262714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.262868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.263021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.263231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.263393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.263555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.263555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264512 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.264965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.265257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.265410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.265410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.265714 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.265877 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.266032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.266192 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.266347 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.266493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.266704 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.266868 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267473 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267779 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.267941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.268087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.268241 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.268386 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.268556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.268804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.268963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.269125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.269271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.269416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.269568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.270834 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271324 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271615 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.271922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.272082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.272237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.272390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.272544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.272689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.272850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.273968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274125 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274561 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 19:53:08.274810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.274810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.275338 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.275338 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.275594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.275959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.276288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.276616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.276960 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.277306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.277673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.277998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.278360 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.278721 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.279078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.279400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.279717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 19:53:08.279971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 19:53:08.333451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO dbcounter [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Registered counter for database nova_api Sep 08 19:53:08.344093 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO dbcounter [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Registered counter for database nova_api Sep 08 19:53:08.355648 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_db.sqlalchemy.engines [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.363276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writer thread running {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.365405 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.372757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writer thread running {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.420511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.context [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5aa0669-26cf-4d36-ab88-a2a225f92acd(cell1) {{(pid=120484) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 19:53:08.424603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:53:08.425078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:53:08.426616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:53:08.427410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:53:08.427867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:53:08.429872 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:53:08.430397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.context [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c5aa0669-26cf-4d36-ab88-a2a225f92acd(cell1) {{(pid=120485) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 19:53:08.431931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO dbcounter [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Registered counter for database nova_cell0 Sep 08 19:53:08.434527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:53:08.435061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:53:08.436082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO dbcounter [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Registered counter for database nova_cell1 Sep 08 19:53:08.436605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:53:08.437359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:53:08.437805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:53:08.439909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:53:08.441975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO dbcounter [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Registered counter for database nova_cell0 Sep 08 19:53:08.443925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_db.sqlalchemy.engines [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.445637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_db.sqlalchemy.engines [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.446326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO dbcounter [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Registered counter for database nova_cell1 Sep 08 19:53:08.451744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writer thread running {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.453371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writer thread running {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.453770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.456426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.460684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writer thread running {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.463825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writer thread running {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.599805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO dbcounter [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Registered counter for database nova_cell0 Sep 08 19:53:08.606671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_db.sqlalchemy.engines [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.611800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writer thread running {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.611947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO dbcounter [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Registered counter for database nova_cell0 Sep 08 19:53:08.619130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 19:53:08.624033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writer thread running {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 19:53:08.923373 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: WARNING keystonemiddleware.auth_token [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:53:08.931063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: WARNING keystonemiddleware.auth_token [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:53:08.937459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: WARNING keystonemiddleware.auth_token [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:53:08.944906 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: WARNING keystonemiddleware.auth_token [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:53:09.275143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: WARNING keystonemiddleware.auth_token [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:53:09.281250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: WARNING keystonemiddleware.auth_token [None req-5e996a52-76a6-496d-9e42-417bc11b7815 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:53:09.286584 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567559d49c0 pid: 120484 (default app) Sep 08 19:53:09.293306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: WARNING keystonemiddleware.auth_token [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 19:53:09.299472 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: WARNING keystonemiddleware.auth_token [None req-b0e8a1bb-7b43-4f7b-8028-7dd502377cf9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 19:53:09.304783 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567559d49c0 pid: 120485 (default app) Sep 08 19:53:45.279021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.280913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.281874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.284183 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.397697 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=3 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.399254 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=3 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.401188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=3 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:45.402327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=3 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:53:46.418879 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c95a5bc6-8fc4-4826-8ffe-1f5a694dd8ac tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Action: 'create', calling method: .version_select at 0x7fef85cbb430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2097276049", "metadata": {"Type": "work"}}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c95a5bc6-8fc4-4826-8ffe-1f5a694dd8ac tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Request method failure captured: Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 122 Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhJn_0nQvwAs30t6k0cFVQ3XhIm2YCwpApzcVFIO7UJx-uI22Od1yqWbVpi0OEyR_Sqrj21iVPxiBrC-Eq5T4nWfCDq-HVHveDOx8sVEQ078IQuyEOSGyvXvoxIfygD0H9rBMK_G06sAoacz7NdnOPVAC3EGGA-283lwx5wiNHAZmA Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:53:46.425166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d6ba0d9a87c473cab713284ac55b5b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b3d486672ded459fa60d96207b183998 Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2097276049", "metadata": {"Type": "work"}}} Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: Sep 08 19:53:46.426550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2097276049', 'metadata': {'Type': 'work'}}}} Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise error Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:46.427374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 19:53:46.428690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 19:53:46.429798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 19:53:46.429798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:46.429798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c95a5bc6-8fc4-4826-8ffe-1f5a694dd8ac tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:46.429798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c95a5bc6-8fc4-4826-8ffe-1f5a694dd8ac tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.043026 Sep 08 19:53:46.429798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1156 bytes} [Thu Sep 8 19:53:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1045 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 19:53:46.438324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-05a8faa6-b53e-449c-971e-a1d11501e80a tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Action: 'create', calling method: .version_select at 0x7fef85cbb3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-706963683", "metadata": {"Type": "work"}}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:46.537478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3f300017-9050-49b1-99a1-608e56f36a28 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Action: 'create', calling method: .version_select at 0x7fef85cbbd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1223789436"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:47.597084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3f300017-9050-49b1-99a1-608e56f36a28 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.168265 Sep 08 19:53:47.607657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Sep 8 19:53:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1170 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 19:53:47.615446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7e9c34c2-fab8-411a-a80a-1c4d9f2e0a85 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Action: 'create', calling method: .version_select at 0x7fef85b4b820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-337765099", "metadata": {"Type": "work"}}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7e9c34c2-fab8-411a-a80a-1c4d9f2e0a85 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Request method failure captured: Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 119 Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhJn_0nQvwAs30t6k0cFVQ3XhIm2YCwpApzcVFIO7UJx-uI22Od1yqWbVpi0OEyR_Sqrj21iVPxiBrC-Eq5T4nWfCDq-HVHveDOx8sVEQ078IQuyEOSGyvXvoxIfygD0H9rBMK_G06sAoacz7NdnOPVAC3EGGA-283lwx5wiNHAZmA Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:53:47.628163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d6ba0d9a87c473cab713284ac55b5b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b3d486672ded459fa60d96207b183998 Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-337765099", "metadata": {"Type": "work"}}} Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: Sep 08 19:53:47.629449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-337765099', 'metadata': {'Type': 'work'}}}} Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise error Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi '0' Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:47.630281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 19:53:47.631566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 19:53:47.632623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 19:53:47.632623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.632623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7e9c34c2-fab8-411a-a80a-1c4d9f2e0a85 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:47.632623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7e9c34c2-fab8-411a-a80a-1c4d9f2e0a85 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.031926 Sep 08 19:53:47.637177 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1156 bytes} [Thu Sep 8 19:53:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 19:53:47.657062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e00fd74c-3032-4a5a-ab58-e23a352c970d tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85c97940>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:47.821457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-05a8faa6-b53e-449c-971e-a1d11501e80a tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.565147 Sep 08 19:53:47.831475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 1/4] 10.222.0.44 () {60 vars in 1156 bytes} [Thu Sep 8 19:53:45 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2568 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 19:53:47.831475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ba7adb2f-17aa-489f-8444-11d8582d85c6 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Action: 'create', calling method: .version_select at 0x7fef85b9d1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1265196123", "metadata": {"Type": "work"}}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ba7adb2f-17aa-489f-8444-11d8582d85c6 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Request method failure captured: Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 119 Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJn_0nQvwAs30t6k0cFVQ3XhIm2YCwpApzcVFIO7UJx-uI22Od1yqWbVpi0OEyR_Sqrj21iVPxiBrC-Eq5T4nWfCDq-HVHveDOx8sVEQ078IQuyEOSGyvXvoxIfygD0H9rBMK_G06sAoacz7NdnOPVAC3EGGA-283lwx5wiNHAZmA Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:47.864151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d6ba0d9a87c473cab713284ac55b5b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b3d486672ded459fa60d96207b183998 Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1265196123", "metadata": {"Type": "work"}}} Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:47.865457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1265196123', 'metadata': {'Type': 'work'}}}} Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise error Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi '' Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:47.866198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 19:53:47.867564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 19:53:47.868636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 19:53:47.868636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:47.868636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ba7adb2f-17aa-489f-8444-11d8582d85c6 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:47.868636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ba7adb2f-17aa-489f-8444-11d8582d85c6 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.044776 Sep 08 19:53:47.872179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e00fd74c-3032-4a5a-ab58-e23a352c970d tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 200 len: 345 microversion: 2.1 time: 0.232835 Sep 08 19:53:47.872756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 4/5] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:47 2022] GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:47.874905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 2/6] 10.222.0.44 () {60 vars in 1156 bytes} [Thu Sep 8 19:53:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 19:53:47.878341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2d7012a7-8b74-4020-87c3-6d23e3857d35 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85b5a040>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:47.911180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-672ddd9e-2df0-4db2-aa98-7a1ff830b2e4 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Calling method '.version_select at 0x7fef85b23ca0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:48.011735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-672ddd9e-2df0-4db2-aa98-7a1ff830b2e4 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] HTTP exception thrown: Volume tempest-invalid-1144082876 could not be found. Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-672ddd9e-2df0-4db2-aa98-7a1ff830b2e4 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Request method failure captured: Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1144082876 HTTP/1.1 Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJn_0nQvwAs30t6k0cFVQ3XhIm2YCwpApzcVFIO7UJx-uI22Od1yqWbVpi0OEyR_Sqrj21iVPxiBrC-Eq5T4nWfCDq-HVHveDOx8sVEQ078IQuyEOSGyvXvoxIfygD0H9rBMK_G06sAoacz7NdnOPVAC3EGGA-283lwx5wiNHAZmA Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:48.016168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d6ba0d9a87c473cab713284ac55b5b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b3d486672ded459fa60d96207b183998 Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Volume tempest-invalid-1144082876 could not be found. Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'tempest-invalid-1144082876'} Sep 08 19:53:48.017557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1144082876 could not be found. (HTTP 404) (Request-ID: req-7dfc4ff2-da26-4f95-b6a4-4e3f434a36a8) Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.018320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 19:53:48.019508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1144082876 could not be found. Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:48.020637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1144082876 could not be found. Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1144082876 could not be found. Sep 08 19:53:48.021773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.024507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-672ddd9e-2df0-4db2-aa98-7a1ff830b2e4 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Returning 404 to user: Volume tempest-invalid-1144082876 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:48.026037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-672ddd9e-2df0-4db2-aa98-7a1ff830b2e4 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1144082876" status: 404 len: 99 microversion: 2.1 time: 0.138644 Sep 08 19:53:48.027195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1218 bytes} [Thu Sep 8 19:53:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1144082876 => generated 99 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 19:53:48.035153 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2d7012a7-8b74-4020-87c3-6d23e3857d35 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.161247 Sep 08 19:53:48.036320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:47 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:48.038533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d6ebe3d3-00ce-4a6c-8423-b415674d99b1 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005038 Sep 08 19:53:48.043964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 4/9] 10.222.0.44 () {58 vars in 1140 bytes} [Thu Sep 8 19:53:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 19:53:48.048716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9629cd5c-86da-42f4-9fad-0bb29a6dd9bd tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004148 Sep 08 19:53:48.053081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 6/10] 10.222.0.44 () {58 vars in 1137 bytes} [Thu Sep 8 19:53:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 08 19:53:48.059255 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bd3e1ae3-60c8-4dc8-961b-f6bbcd529b2d tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Calling method '.version_select at 0x7fef85ab11f0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:48.113710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-bd3e1ae3-60c8-4dc8-961b-f6bbcd529b2d tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] HTTP exception thrown: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bd3e1ae3-60c8-4dc8-961b-f6bbcd529b2d tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Request method failure captured: Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/os-volumes/b190816c-22f6-4244-ba81-469263e9e871 HTTP/1.1 Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJn_0nQvwAs30t6k0cFVQ3XhIm2YCwpApzcVFIO7UJx-uI22Od1yqWbVpi0OEyR_Sqrj21iVPxiBrC-Eq5T4nWfCDq-HVHveDOx8sVEQ078IQuyEOSGyvXvoxIfygD0H9rBMK_G06sAoacz7NdnOPVAC3EGGA-283lwx5wiNHAZmA Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:48.116006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d6ba0d9a87c473cab713284ac55b5b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b3d486672ded459fa60d96207b183998 Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'b190816c-22f6-4244-ba81-469263e9e871'} Sep 08 19:53:48.117548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. (HTTP 404) (Request-ID: req-1844dffe-d4db-452a-aafb-7442258c74d3) Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.118565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 19:53:48.119909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 19:53:48.121512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. Sep 08 19:53:48.123067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.124707 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bd3e1ae3-60c8-4dc8-961b-f6bbcd529b2d tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Returning 404 to user: Volume b190816c-22f6-4244-ba81-469263e9e871 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:48.125559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bd3e1ae3-60c8-4dc8-961b-f6bbcd529b2d tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/b190816c-22f6-4244-ba81-469263e9e871" status: 404 len: 109 microversion: 2.1 time: 0.071175 Sep 08 19:53:48.126135 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 5/11] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 19:53:48 2022] DELETE /compute/v2.1/os-volumes/b190816c-22f6-4244-ba81-469263e9e871 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:53:48.135805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fefd6454-83b5-4e06-b4cf-91a04c74cd72 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Calling method '.version_select at 0x7fef85b5a9d0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:48.181334 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-fefd6454-83b5-4e06-b4cf-91a04c74cd72 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] HTTP exception thrown: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fefd6454-83b5-4e06-b4cf-91a04c74cd72 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Request method failure captured: Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/os-volumes/a7555c3f-94e0-4287-991f-0837128d5422 HTTP/1.1 Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhJn_0nQvwAs30t6k0cFVQ3XhIm2YCwpApzcVFIO7UJx-uI22Od1yqWbVpi0OEyR_Sqrj21iVPxiBrC-Eq5T4nWfCDq-HVHveDOx8sVEQ078IQuyEOSGyvXvoxIfygD0H9rBMK_G06sAoacz7NdnOPVAC3EGGA-283lwx5wiNHAZmA Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:53:48.188612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8d6ba0d9a87c473cab713284ac55b5b1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8d6ba0d9a87c473cab713284ac55b5b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 8d6ba0d9a87c473cab713284ac55b5b1 Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-VolumesNegativeTest-1437144203 Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b3d486672ded459fa60d96207b183998 Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-VolumesNegativeTest-1437144203-project Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'a7555c3f-94e0-4287-991f-0837128d5422'} Sep 08 19:53:48.189923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. (HTTP 404) (Request-ID: req-8e6449a2-de96-485d-9060-e0e8a49640ae) Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.191885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:48.193014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 19:53:48.194132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fefd6454-83b5-4e06-b4cf-91a04c74cd72 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] Returning 404 to user: Volume a7555c3f-94e0-4287-991f-0837128d5422 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fefd6454-83b5-4e06-b4cf-91a04c74cd72 tempest-VolumesNegativeTest-1437144203 tempest-VolumesNegativeTest-1437144203-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a7555c3f-94e0-4287-991f-0837128d5422" status: 404 len: 109 microversion: 2.1 time: 0.058340 Sep 08 19:53:48.195276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 7/12] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:48 2022] GET /compute/v2.1/os-volumes/a7555c3f-94e0-4287-991f-0837128d5422 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:53:48.892973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5d0845ca-ff81-4975-8254-92190e2aed2c tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85b9d550>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:48.994390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5d0845ca-ff81-4975-8254-92190e2aed2c tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 200 len: 346 microversion: 2.1 time: 0.105325 Sep 08 19:53:49.008965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 6/13] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:48 2022] GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:49.009141 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1a4a4558-c30a-4ce0-85f4-2ead7c7f5f07 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Action: 'create', calling method: .version_select at 0x7fef85b5a430>, body: {"snapshot": {"volume_id": "2c8b7db8-428e-47fb-8891-8499ee632acd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-243418112"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:49.050919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-68d36ff5-25a4-4cd6-9602-2265e6d9fd9c tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85ab1670>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.236022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-68d36ff5-25a4-4cd6-9602-2265e6d9fd9c tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 353 microversion: 2.1 time: 0.190040 Sep 08 19:53:49.236914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 7/14] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 353 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:49.241763 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f7f1b36c-49d3-42c0-b0e6-91878d2ce761 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85ab1dc0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.362366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f7f1b36c-49d3-42c0-b0e6-91878d2ce761 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a46b18ba-c3a1-4726-9d1e-e80ef7ff16af" status: 200 len: 349 microversion: 2.1 time: 0.124222 Sep 08 19:53:49.362989 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 8/15] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-volumes/a46b18ba-c3a1-4726-9d1e-e80ef7ff16af => generated 349 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:49.368267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c22c121f-1190-4dd7-bcd3-fb165a349a29 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85ab15e0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.592465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1a4a4558-c30a-4ce0-85f4-2ead7c7f5f07 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.587651 Sep 08 19:53:49.600031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 8/16] 10.222.0.44 () {60 vars in 1162 bytes} [Thu Sep 8 19:53:49 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:49.605640 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5922ca3a-85b0-4c84-8020-7ae816fc3023 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab0160>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.687590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c22c121f-1190-4dd7-bcd3-fb165a349a29 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 353 microversion: 2.1 time: 0.323232 Sep 08 19:53:49.688350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 9/17] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 353 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:49.711583 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-838613a4-d440-481c-bb69-24726edbb55d tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85b23670>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.736983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5922ca3a-85b0-4c84-8020-7ae816fc3023 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.135587 Sep 08 19:53:49.743847 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 9/18] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:49.749591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7729154d-377f-4f3e-a2d4-e252c7b208dc tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85aaf940>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.872863 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-838613a4-d440-481c-bb69-24726edbb55d tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 202 len: 0 microversion: 2.1 time: 0.165164 Sep 08 19:53:49.873981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 10/19] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 19:53:49 2022] DELETE /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 19:53:49.885541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-eabb69ee-9e07-450e-ac93-3b2a5f142f47 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85b9d4c0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:49.947570 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7729154d-377f-4f3e-a2d4-e252c7b208dc tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.202402 Sep 08 19:53:49.948134 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 10/20] 10.222.0.44 () {58 vars in 1140 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:49.960043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ccfc1d59-4898-4e09-921d-45479615ae5f tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab0280>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:50.033602 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-eabb69ee-9e07-450e-ac93-3b2a5f142f47 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.155288 Sep 08 19:53:50.040747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 11/21] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:50.105135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ccfc1d59-4898-4e09-921d-45479615ae5f tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.148897 Sep 08 19:53:50.110485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 11/22] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:49 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:51.049113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4fc8ee1a-c76d-4a21-8712-343d91ad7266 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85ab1d30>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:51.120866 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e646581f-1e09-47a5-9658-04bb33d5ea4b tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab09d0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:51.164518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4fc8ee1a-c76d-4a21-8712-343d91ad7266 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.120014 Sep 08 19:53:51.165093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 12/23] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:51 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:51.333135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e646581f-1e09-47a5-9658-04bb33d5ea4b tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.218225 Sep 08 19:53:51.338314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:51 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:52.181242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3c423911-b2f8-4d5c-b1e2-cc9d67ba636d tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85ab1430>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:52.283902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3c423911-b2f8-4d5c-b1e2-cc9d67ba636d tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.107971 Sep 08 19:53:52.284877 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:52 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:52.346120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-67ba1df5-f5a4-48a4-8026-f274241ddd14 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85b5a550>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:52.413848 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-67ba1df5-f5a4-48a4-8026-f274241ddd14 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.071575 Sep 08 19:53:52.414768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 13/26] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:52 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:53.300362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fa6732b2-dc68-4406-98e2-6a11f1409e75 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85b9d5e0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:53.426952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-37110e81-8bbc-41f9-b80b-b188768de0d0 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85aaf0d0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:53.482487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fa6732b2-dc68-4406-98e2-6a11f1409e75 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.187203 Sep 08 19:53:53.483292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 14/27] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:53 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:53.558854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-37110e81-8bbc-41f9-b80b-b188768de0d0 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.134431 Sep 08 19:53:53.562274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 14/28] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:53 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:54.513203 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9c94b528-74e4-41cb-9b82-1d46cffbebd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85abb0d0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:54.576213 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-175ee102-b695-4d87-b6b1-59b51e2024d2 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85aaf790>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:54.612644 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9c94b528-74e4-41cb-9b82-1d46cffbebd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.119119 Sep 08 19:53:54.613674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 15/29] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:54 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:54.639850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-175ee102-b695-4d87-b6b1-59b51e2024d2 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.069337 Sep 08 19:53:54.640444 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 15/30] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:54 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:55.629928 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a8edc156-a303-4c9f-827b-2cd79bae0635 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85ab18b0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:55.659352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-561b2476-b07d-4bf5-a401-d4460a48dabe tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab08b0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:55.706579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-561b2476-b07d-4bf5-a401-d4460a48dabe tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.051050 Sep 08 19:53:55.708231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 16/31] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:55 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:55.777847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a8edc156-a303-4c9f-827b-2cd79bae0635 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 200 len: 352 microversion: 2.1 time: 0.153078 Sep 08 19:53:55.779486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 16/32] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:55 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 352 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:56.160605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1233668010", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "networks": [{"uuid": "f491e9cc-e912-4a37-9357-739a52a0f684"}]}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:56.383484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] validate_networks() for [('f491e9cc-e912-4a37-9357-739a52a0f684', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:53:56.719878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bfcc17a4-510b-4c95-b94e-90a777559053 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab1940>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:56.786685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bfcc17a4-510b-4c95-b94e-90a777559053 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 287 microversion: 2.1 time: 0.070402 Sep 08 19:53:56.787280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 17/33] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:56 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:56.807828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0eec29c6-aa14-45a2-9385-58f2eb0fadd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Calling method '.version_select at 0x7fef85b23040>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:56.844866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-0eec29c6-aa14-45a2-9385-58f2eb0fadd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] HTTP exception thrown: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0eec29c6-aa14-45a2-9385-58f2eb0fadd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Request method failure captured: Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e HTTP/1.1 Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJAxTuV2-6rm75Qwx2o_WF91cV91p6zc0jcHy1zPojtUdsXTAa1_lOnk8C6OhlwP8Xw9_YosTgnByaIQ5c_Vd7mZhiSnaaGMksDCAeLcfA7DIQ3oBaPsr_swzAXNEhqe986fGCT1WEVls7evLG0evLgC-xQooFsL_RYGDIyvsRtEU Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 24d48d40619b4365a8a6e4af2453042d Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesGetTestJSON-1521885731 Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:56.846850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/24d48d40619b4365a8a6e4af2453042d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_24d48d40619b4365a8a6e4af2453042d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/24d48d40619b4365a8a6e4af2453042d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/24d48d40619b4365a8a6e4af2453042d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesGetTestJSON-1521885731 Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 24d48d40619b4365a8a6e4af2453042d Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesGetTestJSON-1521885731 Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesGetTestJSON-1521885731-project Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 36e2c9fcb0cc4b3a835870a5fd5558e8 Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesGetTestJSON-1521885731-project Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'eb2395f3-be9e-4549-9998-cf960b96194e'} Sep 08 19:53:56.847946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. (HTTP 404) (Request-ID: req-0fe82641-6905-4050-a580-00342e078b47) Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:56.848581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:56.849523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 19:53:56.850391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0eec29c6-aa14-45a2-9385-58f2eb0fadd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] Returning 404 to user: Volume eb2395f3-be9e-4549-9998-cf960b96194e could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0eec29c6-aa14-45a2-9385-58f2eb0fadd9 tempest-VolumesGetTestJSON-1521885731 tempest-VolumesGetTestJSON-1521885731-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e" status: 404 len: 109 microversion: 2.1 time: 0.049909 Sep 08 19:53:56.852759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 18/34] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:56 2022] GET /compute/v2.1/os-volumes/eb2395f3-be9e-4549-9998-cf960b96194e => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:53:56.855230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-203b8241-bcba-4989-b2ce-6cdb5f88649a tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85b23f70>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:57.017384 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-203b8241-bcba-4989-b2ce-6cdb5f88649a tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 202 len: 0 microversion: 2.1 time: 0.166278 Sep 08 19:53:57.018976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 19/35] 10.222.0.44 () {58 vars in 1254 bytes} [Thu Sep 8 19:53:56 2022] DELETE /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 19:53:57.024994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2ea777cd-5fbb-4fc8-958a-a752dcfc18b3 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85ab1280>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:57.149896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2ea777cd-5fbb-4fc8-958a-a752dcfc18b3 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0d3c3ff0-e0e3-4e36-ad63-d44be092228e" status: 200 len: 351 microversion: 2.1 time: 0.129130 Sep 08 19:53:57.150483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 20/36] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:57 2022] GET /compute/v2.1/os-volumes/0d3c3ff0-e0e3-4e36-ad63-d44be092228e => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:57.164789 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fa9f4bb0-7b6e-4720-9971-35f4512cc407 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85b9d550>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:57.217810 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fa9f4bb0-7b6e-4720-9971-35f4512cc407 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 200 len: 286 microversion: 2.1 time: 0.057128 Sep 08 19:53:57.219927 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 21/37] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:57 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:58.230974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f5951011-80bf-420e-bed6-65cb032cc0e4 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85abb1f0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:58.277904 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-f5951011-80bf-420e-bed6-65cb032cc0e4 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] HTTP exception thrown: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f5951011-80bf-420e-bed6-65cb032cc0e4 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Request method failure captured: Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 HTTP/1.1 Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJpCjfmM314LzbMohEgELZ6ozkFBU1kqTrJgsAnoSPw-QndOUqTl8KL0P4jDHB7W251ecPIDBoN9KFbUi_4B9jAtJm5XGXt0wOogZIj8Fl1VLrIpDvLWoAOBJtnQnBP-aNZlbTPt6tM5S1AGGt8jtFDtDsQy_2qPaYdePXVd6Tlhs Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:58.280704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e1a229a664a54d7aa30f0581efb8bb49", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: c4d50bc39f3c4a778ccb8b3232c9a54d Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337'} Sep 08 19:53:58.282007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. (HTTP 404) (Request-ID: req-9b6aec59-8062-4dd5-98e5-c4dbe41231fc) Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:58.287817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 19:53:58.288815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f5951011-80bf-420e-bed6-65cb032cc0e4 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Returning 404 to user: Snapshot bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f5951011-80bf-420e-bed6-65cb032cc0e4 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337" status: 404 len: 111 microversion: 2.1 time: 0.055261 Sep 08 19:53:58.289716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 22/38] 10.222.0.44 () {58 vars in 1251 bytes} [Thu Sep 8 19:53:58 2022] GET /compute/v2.1/os-snapshots/bb549b3e-cbe9-4a2c-9351-1bcd6e3ff337 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:53:58.294219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2c0586fc-d8c6-402a-a0a5-701ded978a6d tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab10d0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:58.406806 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2c0586fc-d8c6-402a-a0a5-701ded978a6d tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 202 len: 0 microversion: 2.1 time: 0.116131 Sep 08 19:53:58.407516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 23/39] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 19:53:58 2022] DELETE /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 19:53:58.416892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-594b186a-71d1-4d27-9a1d-b4baae8b4948 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85ab1e50>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:58.529158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-594b186a-71d1-4d27-9a1d-b4baae8b4948 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 200 len: 345 microversion: 2.1 time: 0.117496 Sep 08 19:53:58.529802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 24/40] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:58 2022] GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:58.837107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:53:58.838049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:53:58.838615 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:53:58.839135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:53:58.839566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:53:58.890084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:53:58.890592 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:53:58.893709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:53:58.894511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:53:58.895009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:53:58.897000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:53:59.001059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Getting quotas for project 508edea792734bd89f391e57c49c614f. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:53:59.013750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Getting quotas for user 1087faee65634c22a59a6f6773e80484 and project 508edea792734bd89f391e57c49c614f. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:53:59.037617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:53:59.054590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:53:59.254448 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1559049c-fd35-47a7-ac28-2adc5c45c405 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.302173 Sep 08 19:53:59.267036 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 17/41] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:53:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:53:59.278084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cefc1cc3-7985-40d0-a74a-1f95fff3ed55 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef851b2af0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:59.300567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-10c74429-b67d-4ff8-8e4a-bd03bf75d40c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: .version_select at 0x7fef85b9d700>, body: {"keypair": {"name": "tempest-keypair-554176980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSQZe+ElK0lkslLfhQi03FfjJZh1lG/7SDutXFkr1vRDDKN0hnW35+hW1T5bbuN9RUpF7bc19ER0nWT9ha472BzWD+Xk3D7B43ThMOe/6IWOHGBXauuzYd61Wtbm4mN0A=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:53:59.382385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cefc1cc3-7985-40d0-a74a-1f95fff3ed55 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/ec68d819-ae00-464e-aa79-9b04e5784815" status: 200 len: 350 microversion: 2.1 time: 0.114012 Sep 08 19:53:59.382990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 18/42] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:59 2022] GET /compute/v2.1/os-volumes/ec68d819-ae00-464e-aa79-9b04e5784815 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:53:59.387619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1596c812-4bd7-4344-b582-692aab1ce908 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:59.388870 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1596c812-4bd7-4344-b582-692aab1ce908 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:53:59.579713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-10c74429-b67d-4ff8-8e4a-bd03bf75d40c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:53:59.602035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-10c74429-b67d-4ff8-8e4a-bd03bf75d40c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:53:59.645713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1596c812-4bd7-4344-b582-692aab1ce908 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:53:59.676745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1596c812-4bd7-4344-b582-692aab1ce908 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1215 microversion: 2.1 time: 0.292675 Sep 08 19:53:59.677348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 19/43] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:53:59 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:53:59.724188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-02fcc4bc-a8af-44de-a057-2626e4e00323 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef851cfd30>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:59.731842 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-10c74429-b67d-4ff8-8e4a-bd03bf75d40c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.906429 Sep 08 19:53:59.744501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 25/44] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 19:53:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:53:59.757993 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4ed49f5-fb07-4660-9c0b-0b16b0bd7a96 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85a48310>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:59.810753 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-a4ed49f5-fb07-4660-9c0b-0b16b0bd7a96 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] HTTP exception thrown: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4ed49f5-fb07-4660-9c0b-0b16b0bd7a96 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Request method failure captured: Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd HTTP/1.1 Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJpCjfmM314LzbMohEgELZ6ozkFBU1kqTrJgsAnoSPw-QndOUqTl8KL0P4jDHB7W251ecPIDBoN9KFbUi_4B9jAtJm5XGXt0wOogZIj8Fl1VLrIpDvLWoAOBJtnQnBP-aNZlbTPt6tM5S1AGGt8jtFDtDsQy_2qPaYdePXVd6Tlhs Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:59.813396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e1a229a664a54d7aa30f0581efb8bb49", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: c4d50bc39f3c4a778ccb8b3232c9a54d Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '2c8b7db8-428e-47fb-8891-8499ee632acd'} Sep 08 19:53:59.814822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. (HTTP 404) (Request-ID: req-7c1accb9-0914-4a11-8fcc-532053df6067) Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:59.815578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:53:59.816454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 19:53:59.817496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4ed49f5-fb07-4660-9c0b-0b16b0bd7a96 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Returning 404 to user: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:59.818369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a4ed49f5-fb07-4660-9c0b-0b16b0bd7a96 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 404 len: 109 microversion: 2.1 time: 0.068034 Sep 08 19:53:59.822826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 26/45] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:59 2022] GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:53:59.840964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e8aa139b-7939-47a6-be36-07445011e8ec tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85b9d0d0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:53:59.914467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-e8aa139b-7939-47a6-be36-07445011e8ec tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] HTTP exception thrown: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e8aa139b-7939-47a6-be36-07445011e8ec tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Request method failure captured: Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd HTTP/1.1 Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJpCjfmM314LzbMohEgELZ6ozkFBU1kqTrJgsAnoSPw-QndOUqTl8KL0P4jDHB7W251ecPIDBoN9KFbUi_4B9jAtJm5XGXt0wOogZIj8Fl1VLrIpDvLWoAOBJtnQnBP-aNZlbTPt6tM5S1AGGt8jtFDtDsQy_2qPaYdePXVd6Tlhs Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:53:59.916554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e1a229a664a54d7aa30f0581efb8bb49", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: c4d50bc39f3c4a778ccb8b3232c9a54d Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '2c8b7db8-428e-47fb-8891-8499ee632acd'} Sep 08 19:53:59.917624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. (HTTP 404) (Request-ID: req-f102affa-2238-439b-874a-c8ca2facd5de) Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:59.918243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 19:53:59.919782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 19:53:59.920769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e8aa139b-7939-47a6-be36-07445011e8ec tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Returning 404 to user: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e8aa139b-7939-47a6-be36-07445011e8ec tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 404 len: 109 microversion: 2.1 time: 0.085371 Sep 08 19:53:59.921645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 27/46] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 19:53:59 2022] DELETE /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:53:59.926621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c19f4839-4553-45f9-93f2-eaf5ac77dd89 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Calling method '.version_select at 0x7fef85a48d30>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:00.007819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-c19f4839-4553-45f9-93f2-eaf5ac77dd89 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] HTTP exception thrown: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c19f4839-4553-45f9-93f2-eaf5ac77dd89 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Request method failure captured: Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd HTTP/1.1 Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhJpCjfmM314LzbMohEgELZ6ozkFBU1kqTrJgsAnoSPw-QndOUqTl8KL0P4jDHB7W251ecPIDBoN9KFbUi_4B9jAtJm5XGXt0wOogZIj8Fl1VLrIpDvLWoAOBJtnQnBP-aNZlbTPt6tM5S1AGGt8jtFDtDsQy_2qPaYdePXVd6Tlhs Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:54:00.013402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e1a229a664a54d7aa30f0581efb8bb49", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e1a229a664a54d7aa30f0581efb8bb49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: e1a229a664a54d7aa30f0581efb8bb49 Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-171056714 Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: c4d50bc39f3c4a778ccb8b3232c9a54d Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesSnapshotsTestJSON-171056714-project Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '2c8b7db8-428e-47fb-8891-8499ee632acd'} Sep 08 19:54:00.015066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. (HTTP 404) (Request-ID: req-66fa9742-d9b7-4c37-8b8f-5607b6c42f8f) Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:54:00.015847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 19:54:00.016917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 19:54:00.018242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. Sep 08 19:54:00.019560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:54:00.021181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c19f4839-4553-45f9-93f2-eaf5ac77dd89 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] Returning 404 to user: Volume 2c8b7db8-428e-47fb-8891-8499ee632acd could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:54:00.023397 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c19f4839-4553-45f9-93f2-eaf5ac77dd89 tempest-VolumesSnapshotsTestJSON-171056714 tempest-VolumesSnapshotsTestJSON-171056714-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd" status: 404 len: 109 microversion: 2.1 time: 0.100577 Sep 08 19:54:00.025202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 28/47] 10.222.0.44 () {58 vars in 1245 bytes} [Thu Sep 8 19:53:59 2022] GET /compute/v2.1/os-volumes/2c8b7db8-428e-47fb-8891-8499ee632acd => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:54:00.076992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-02fcc4bc-a8af-44de-a057-2626e4e00323 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.380582 Sep 08 19:54:00.077571 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 20/48] 10.222.0.44 () {58 vars in 1134 bytes} [Thu Sep 8 19:53:59 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:00.099262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-16c5b3f1-f9ab-4d1b-a90f-d83550a2e149 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85a48af0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:00.363063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-16c5b3f1-f9ab-4d1b-a90f-d83550a2e149 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.274162 Sep 08 19:54:00.363742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 29/49] 10.222.0.44 () {58 vars in 1149 bytes} [Thu Sep 8 19:54:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:00.380710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8489ce4a-639c-4073-917d-c292c81c9d4c tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85abbb80>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:00.714533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8489ce4a-639c-4073-917d-c292c81c9d4c tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.336556 Sep 08 19:54:00.715709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 30/50] 10.222.0.44 () {58 vars in 1134 bytes} [Thu Sep 8 19:54:00 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:00.734530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6f7b5887-59ae-4ae4-acfb-3f0130536cb5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:00.735705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6f7b5887-59ae-4ae4-acfb-3f0130536cb5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:01.000675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6f7b5887-59ae-4ae4-acfb-3f0130536cb5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:01.036105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6f7b5887-59ae-4ae4-acfb-3f0130536cb5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1215 microversion: 2.1 time: 0.318941 Sep 08 19:54:01.036709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 31/51] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:00 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:01.054894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-912faf2a-79cd-4263-bd0b-d6e358cb0504 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85a5de50>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:01.243449 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-912faf2a-79cd-4263-bd0b-d6e358cb0504 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.205651 Sep 08 19:54:01.244023 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 32/52] 10.222.0.44 () {58 vars in 1167 bytes} [Thu Sep 8 19:54:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:01.258429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6fa9b024-5735-4228-88e2-98b8ba21ed6b tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85a13d30>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:01.323852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1e064f61-8714-4469-9611-f7686818eb39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: .version_select at 0x7fef85173e50>, body: {"keypair": {"name": "tempest-keypair-1155869417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3PvPcuE8jE76Xg6o1Og3DrO4d5TaypKBmZ0gAt1jXS0CPP1fLZR5Kr5JT+64RslsNMHhHn2qPBLcxikUxGb7iR552CKitjONmq8qt2GrRzfHo52733REEYkHMVD1QUqQ=="}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:01.395312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-1e064f61-8714-4469-9611-f7686818eb39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:54:01.423954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-1e064f61-8714-4469-9611-f7686818eb39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for user 14824e303e544aa6b206e0692f703e5a and project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:54:01.521104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6fa9b024-5735-4228-88e2-98b8ba21ed6b tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.266840 Sep 08 19:54:01.521716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 33/53] 10.222.0.44 () {58 vars in 1170 bytes} [Thu Sep 8 19:54:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:54:01.532290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1e064f61-8714-4469-9611-f7686818eb39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.240847 Sep 08 19:54:01.534379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 21/54] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 19:54:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:01.536392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-696256a1-bdfb-4ad0-b0da-5427ee91f063 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85a13af0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:01.766452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-696256a1-bdfb-4ad0-b0da-5427ee91f063 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.234047 Sep 08 19:54:01.767064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 34/55] 10.222.0.44 () {58 vars in 1155 bytes} [Thu Sep 8 19:54:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:01.789345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-54728384-4278-4eb8-b4b0-18d0cf6d9eb3 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85173670>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:02.064224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:02.065259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:02.076018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:02.077076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:02.077985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:02.078233 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-54728384-4278-4eb8-b4b0-18d0cf6d9eb3 tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.300922 Sep 08 19:54:02.079132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 22/56] 10.222.0.44 () {58 vars in 1188 bytes} [Thu Sep 8 19:54:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:02.092873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-62ccef79-9f32-44fa-b1b9-cc4fa0077c9f tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] Calling method '.version_select at 0x7fef85180670>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:02.096055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:02.096957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:02.098906 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:02.438898 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-62ccef79-9f32-44fa-b1b9-cc4fa0077c9f tempest-VolumesTestJSON-347503489 tempest-VolumesTestJSON-347503489-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.349933 Sep 08 19:54:02.439864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 23/57] 10.222.0.44 () {58 vars in 1155 bytes} [Thu Sep 8 19:54:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:02.940769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:02.967305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7a6c9be3-bee6-4faf-bb46-798fa35d4de0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1211 microversion: 2.1 time: 0.906598 Sep 08 19:54:02.967305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 35/58] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:02 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1211 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:03.994941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:03.995699 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:04.019946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:04.025382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:04.026354 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:04.034123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:04.034914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:04.037458 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:04.556039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:04.578187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9ccdac86-76d3-4b37-b566-682a4c8f1310 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1273 microversion: 2.1 time: 0.590239 Sep 08 19:54:04.592423 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 24/59] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:03 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1273 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:05.606216 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:05.607254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:05.618342 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:05.619060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:05.624424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:05.625441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:05.626062 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:05.631026 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:05.985247 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1337434364", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e992bb3-3c6d-436c-8011-0fb47db3a78e"}], "security_groups": [{"name": "tempest-securitygroup--317428060"}], "key_name": "tempest-keypair-554176980", "user_data": "}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:06.089838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:06.103677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-914311f4-f0fe-449b-b2f6-479d39ed91dd tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.502533 Sep 08 19:54:06.104399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 36/60] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:05 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:06.319888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] validate_networks() for [('9e992bb3-3c6d-436c-8011-0fb47db3a78e', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:54:06.546093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-961338584", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41954cc4-6511-4766-b853-67fe7cbcb4e7"}], "security_groups": [{"name": "tempest-securitygroup--665085973"}], "key_name": "tempest-keypair-1155869417", "user_data": "}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:06.826051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] validate_networks() for [('41954cc4-6511-4766-b853-67fe7cbcb4e7', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:54:07.421071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:54:07.421599 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:54:07.422159 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:54:07.422926 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:54:07.423323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:54:07.453884 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:07.456842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:07.457527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:07.458825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:07.459714 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:07.462065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:07.563469 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:54:07.586166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:54:07.632407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:54:07.636253 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:54:07.762445 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a0445c31-00f4-4f24-93f3-7b9d77ce3463 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.783544 Sep 08 19:54:07.763728 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 25/61] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:54:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:54:07.778552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:07.779971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:07.813534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:07.816248 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:07.817226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:07.822858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:07.823749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:07.824417 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:09.125978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:09.144809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ad04fae4-4e36-4c26-99e0-a01b63fc583c tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 1.378475 Sep 08 19:54:09.145438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 26/62] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:07 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:09.166145 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-649d7e91-2178-4183-a0d2-12224ead37fe tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:09.166805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-649d7e91-2178-4183-a0d2-12224ead37fe tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:09.507949 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-649d7e91-2178-4183-a0d2-12224ead37fe tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:09.519889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-649d7e91-2178-4183-a0d2-12224ead37fe tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1241 microversion: 2.1 time: 0.368109 Sep 08 19:54:09.532881 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 27/63] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:09 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1241 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:10.173108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:10.173935 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:10.206032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:10.207732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:10.216163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:10.225121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:10.229588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:10.233305 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:10.894340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:54:10.894930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:54:10.895502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:54:10.895924 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:54:10.896692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:54:10.916705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:10.918479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:10.924419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:10.927014 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:10.928294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:10.928795 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:10.990742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:54:11.004787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for user 14824e303e544aa6b206e0692f703e5a and project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:54:11.027294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:54:11.031168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:54:11.296912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a80749fa-d7f3-4aa6-ba66-b49d36bf4016 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.756794 Sep 08 19:54:11.308142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 37/64] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:54:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 4769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:54:11.329672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:11.330809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:11.330947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:11.339354 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4a934413-991c-4f5f-afd9-f9577262f3f7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 1.170168 Sep 08 19:54:11.343216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 28/65] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:10 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:11.349401 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-78dee6a5-dae7-4115-85e7-887ebf784d33 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:11.350026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-78dee6a5-dae7-4115-85e7-887ebf784d33 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:11.385430 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:11.386001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:11.386409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:11.391624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:11.392122 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:11.392730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:11.614028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:11.643583 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e8eb417e-ef76-429d-b853-a8e9869b32e8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1301 microversion: 2.1 time: 0.329535 Sep 08 19:54:11.647380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 38/66] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:11 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1301 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:11.659739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-78dee6a5-dae7-4115-85e7-887ebf784d33 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:11.674248 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-78dee6a5-dae7-4115-85e7-887ebf784d33 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1237 microversion: 2.1 time: 0.328836 Sep 08 19:54:11.680482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 29/67] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:11 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1237 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:12.409865 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:12.414021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:12.428105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:12.429302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:12.430164 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:12.432866 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:12.433546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:12.435108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:12.829547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a136ee37-8423-41cc-93ff-f41b65bcef44", "tag": "fefd716b-9140-4570-909b-43c5c9b1e2cd"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:12.873033 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:12.877037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:12.878798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:12.959866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Creating event network-changed:fefd716b-9140-4570-909b-43c5c9b1e2cd for instance a136ee37-8423-41cc-93ff-f41b65bcef44 on hv-cinder-83124 Sep 08 19:54:12.961970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120484) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 19:54:12.962829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-40b8337d-431c-4588-8bf5-f2eedae63cdc req-cb311b8a-bcb5-4049-93c6-5ba64deea4b4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120484) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 19:54:12.970080 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:12.971089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:12.972659 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:12.976547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:12.977334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:12.978815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:13.021428 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.compute.rpcapi [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 19:54:13.022353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] Releasing lock "compute-rpcapi-router" {{(pid=120484) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 19:54:13.033488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:13.044329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-db38039f-4bb7-4112-924d-fb4e3fad98ea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.666847 Sep 08 19:54:13.050247 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 30/68] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:12 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:13.059908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:13.072000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:13.085099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a1d4a8c4-0712-4e59-b224-331e8c1b5235 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.760170 Sep 08 19:54:13.088371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 39/69] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:13.103945 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:13.107007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:13.108055 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:13.110050 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:13.111427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:13.113285 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:13.114348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:13.116090 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:13.144777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:13.147699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:13.152567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:13.153610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:13.155349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:13.158478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:13.435448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:13.475731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:13.477179 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ac0f497f-7e9c-418e-8c70-c9a45f3d6e68 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1289 microversion: 2.1 time: 0.373697 Sep 08 19:54:13.481060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 40/70] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:13 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1289 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:13.483992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-56c81547-07b9-43d7-8f6d-d1a65f3dd662 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1299 microversion: 2.1 time: 0.432615 Sep 08 19:54:13.492339 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 31/71] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:13 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1299 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:14.074127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:14.075852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:14.090813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:14.091689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:14.094442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:14.096026 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:14.097249 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:14.098330 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:14.512663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:14.513891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:14.535089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:14.537413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:14.540320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:14.542307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:14.547492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:14.548663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:14.817029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:14.844106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cbd29245-2be5-4d99-8a07-e87897d3d589 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1295 microversion: 2.1 time: 0.319706 Sep 08 19:54:14.844775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 32/72] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:14 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1295 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:14.861690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:14.862307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:14.889948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:14.890208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:14.890681 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:14.894058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:14.896405 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:14.904298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:15.121461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:15.136653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1ede8f4d-1781-43d5-b1a9-0842be932836 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 1.066910 Sep 08 19:54:15.139333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 41/73] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:14 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:15.625430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:15.633689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e5093b6f-4825-4504-946a-7d441bef17ad tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.779720 Sep 08 19:54:15.640914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 33/74] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:14 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:15.872716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:15.874333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:15.886758 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:15.887920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:15.888527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:15.889975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:15.891227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:15.893398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:16.165106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:16.165824 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:16.175390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:16.182086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:16.182581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:16.185890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:16.185890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:16.185890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:16.340306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:16.350913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1dcac49b-f282-466e-9735-93989490deab tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1295 microversion: 2.1 time: 0.486042 Sep 08 19:54:16.355875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 42/75] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:15 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1295 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:16.667585 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:16.676591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:16.681636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:16.707179 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:16.708525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-76e1cd84-d9c0-4539-9500-bd397b92b581 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.543972 Sep 08 19:54:16.711723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 34/76] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:16 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:16.712510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:16.714378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:16.716950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:16.718794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:16.719264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:17.145089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:17.160316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c496a599-b7a6-409c-9f0f-2161080d5cb6 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.504129 Sep 08 19:54:17.162495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 43/77] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:16 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:17.383851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:17.384893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:17.396839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:17.397339 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:17.397783 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:17.398556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:17.421362 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:17.429029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:17.529896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:17.736787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:17.737401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:17.749662 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:17.750307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:17.750909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:17.752078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:17.752512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:17.773287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:18.450815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:18.466578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2a939bd6-8012-4fed-a71f-1cabf8fd717b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 1.090160 Sep 08 19:54:18.472289 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 35/78] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:17 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:18.485052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:18.492416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:18.509826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:18.513083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:18.513924 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:18.514403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:18.519318 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:18.521969 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:18.524437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:18.526484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-85451057-d10e-4fbc-91d9-a1f62909fb26 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.792709 Sep 08 19:54:18.546022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 44/79] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:17 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:18.944601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:18.960771 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-dd0b84a3-9a4f-4005-a1b0-34162def1452 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.487047 Sep 08 19:54:18.964111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 36/80] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:18 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:19.468641 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22bff83-6076-4522-87b8-762a5ee75a3f", "tag": "aa0a5896-bbc1-43fe-818e-f9d2e827cbaa"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:19.486439 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.487304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.488755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.512581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Creating event network-changed:aa0a5896-bbc1-43fe-818e-f9d2e827cbaa for instance c22bff83-6076-4522-87b8-762a5ee75a3f on hv-cinder-83124 Sep 08 19:54:19.513455 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 19:54:19.514068 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-282ba6ae-3313-483c-8933-c0cd0d8bcc2b req-0fff9c85-d7e0-41aa-9b29-94a3c217a754 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 19:54:19.515381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.516042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.516467 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.517690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.518629 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.519288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.529807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.compute.rpcapi [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 19:54:19.531288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] Releasing lock "compute-rpcapi-router" {{(pid=120485) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 19:54:19.540578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-b7c71f6b-adf6-4f0b-b263-abf36a6de68f req-41b090dc-6366-4d44-b90d-23e7b11540e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f740383-c694-46e4-adea-1b308e00014e", "tag": "f448e2c8-6562-498b-8c79-0c3b9eded991"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:19.560523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-b7c71f6b-adf6-4f0b-b263-abf36a6de68f req-41b090dc-6366-4d44-b90d-23e7b11540e1 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.564619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8ccc4c4a-2bbe-4c1b-8fd0-94268166df34 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100430 Sep 08 19:54:19.567510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 37/81] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:19.571071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-b7c71f6b-adf6-4f0b-b263-abf36a6de68f req-41b090dc-6366-4d44-b90d-23e7b11540e1 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.571515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-b7c71f6b-adf6-4f0b-b263-abf36a6de68f req-41b090dc-6366-4d44-b90d-23e7b11540e1 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.580200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:19.581196 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:19.592505 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.593175 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.593927 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.595534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.595765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-b7c71f6b-adf6-4f0b-b263-abf36a6de68f req-41b090dc-6366-4d44-b90d-23e7b11540e1 service nova] Creating event network-changed:f448e2c8-6562-498b-8c79-0c3b9eded991 for instance 6f740383-c694-46e4-adea-1b308e00014e on hv-cinder-83124 Sep 08 19:54:19.596017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.596534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.609008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-b7c71f6b-adf6-4f0b-b263-abf36a6de68f req-41b090dc-6366-4d44-b90d-23e7b11540e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.589560 Sep 08 19:54:19.612146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 45/82] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:19.620093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:19.620799 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:19.657347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.660552 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.661011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.663262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:19.663953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:19.664533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:19.893198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:19.910625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7b4e03db-fa00-48fb-9cdd-2e25c17f978f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.338159 Sep 08 19:54:19.916872 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:19.924150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 38/83] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:19 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:19.931991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5431a575-517a-4d43-9b1d-c379d28a5661 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.318569 Sep 08 19:54:19.948397 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 46/84] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:19 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:19.987829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:19.989140 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:19.999798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:20.000286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:20.001082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:20.003183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:20.003710 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:20.004279 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:20.289604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:20.301822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2e2d02bc-4a78-4f1e-8421-1700e3d3a2de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.317332 Sep 08 19:54:20.321991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 39/85] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:19 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:20.945901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:20.949265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:20.955527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:20.956136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:20.958153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:20.959137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:20.960684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:20.962047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:20.962682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:20.963775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:20.973508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:20.974073 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:20.975663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:20.979828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:20.980300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:20.982929 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:21.020787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=12 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:21.288535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:21.293881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:21.299051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fa04f2f7-8c82-4741-abab-e4f8155e99ed tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.346637 Sep 08 19:54:21.299661 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 40/86] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:20 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:21.318134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-12eb5678-8be4-4f1e-9700-de42dbe3957e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.379511 Sep 08 19:54:21.324537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:21.325152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:21.328316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 47/87] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:20 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:21.331641 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:21.332398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:21.333064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:21.334108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:21.334767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:21.335551 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:21.501892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:21.512497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-43e91121-1f03-41fd-9542-9f70f71b5efd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.191825 Sep 08 19:54:21.514706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 41/88] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:21 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:22.323610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:22.324285 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:22.331575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:22.332075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:22.332699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:22.333757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:22.334502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:22.334958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:22.345938 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:22.346806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:22.354342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=22 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:22.357224 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:22.358016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:22.359700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:22.359700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:22.360303 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:22.364462 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:22.548258 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:22.557007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-258718fb-527f-41a4-991a-5116197a6569 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.216538 Sep 08 19:54:22.559260 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 42/89] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:22 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:22.564550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:22.565311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:22.571403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:22.572064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:22.572652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:22.573492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:22.574079 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:22.574665 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:22.579568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:22.603909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:22.615211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-80965224-9af9-4754-ba88-8bdc0dff44bf tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.297262 Sep 08 19:54:22.616113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 48/90] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:22 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:22.779065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:22.788727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a046e595-29c7-4d35-bfd5-48a1326acb9a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.228180 Sep 08 19:54:22.789455 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 43/91] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:22 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:23.580624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:23.581442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:23.587134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:23.589720 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:23.590390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:23.590865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:23.591775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:23.592306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:23.592745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:23.640286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:23.642136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:23.650619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:23.664281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:23.664966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:23.665855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:23.667076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:23.667678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:23.841639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:23.850327 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-492c7bec-b51d-4d3b-8c3b-47141c15a974 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.273856 Sep 08 19:54:23.851252 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 49/92] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:23 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:23.856517 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:23.857129 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:23.863324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:23.863809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:23.864247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:23.864943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:23.865395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:23.865818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:23.875174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:23.885713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-17206031-b4ee-47b8-ba04-4b1a0f5822af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.251523 Sep 08 19:54:23.887112 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 44/93] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:23 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:24.030712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:24.039452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a8c172e3-3cec-4e9d-81b9-b7ea48c7e5c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.186511 Sep 08 19:54:24.040128 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 50/94] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:23 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:24.873384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:24.874148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:24.885428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:24.886035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:24.886510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:24.887405 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:24.887908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:24.888327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:24.908112 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:24.908720 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:24.914563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:24.915090 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:24.915524 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:24.916218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:24.916660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:24.917079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:25.018958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:25.027144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c0a300ef-1ebb-46e2-a71b-16e081210508 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.157521 Sep 08 19:54:25.027755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 45/95] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:24 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:25.047170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:25.052048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3995a748-717e-429f-ac11-d7b6e7d38e00 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.147760 Sep 08 19:54:25.052640 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 51/96] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:24 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:25.065496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:25.066134 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:25.073370 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:25.074049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:25.074630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:25.075708 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:25.076330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:25.076751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:25.213311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:25.221616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9456f2cc-220c-4b09-92e9-661b6fe6d74d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.159930 Sep 08 19:54:25.222133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 46/97] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:25 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:26.049606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:26.050211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:26.052139 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:26.058107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:26.058620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:26.059130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:26.059908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:26.060573 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:26.061073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:26.066797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=93 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:26.074768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:26.075449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:26.077317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:26.082693 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:26.083183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:26.083649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:26.084351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:26.084805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:26.085228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:26.206423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:26.214603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-190e809e-edf7-4e83-904d-dd75139dfa13 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.168856 Sep 08 19:54:26.215218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 52/98] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:26 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:26.220084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:26.228055 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1f81d0bc-46e0-4867-878c-0e0ce0f240e1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.157124 Sep 08 19:54:26.228628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 47/99] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:26 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:26.243603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:26.244205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:26.250440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:26.251045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:26.251841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:26.252541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:26.253001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:26.253434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:26.385581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:26.393606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-59b6d9c8-9254-4f52-885a-14f20a5f8875 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.153749 Sep 08 19:54:26.394180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 53/100] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:26 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:27.238080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:27.239270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:27.245952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:27.246512 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:27.246965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:27.247906 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:27.248715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:27.249510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:27.253195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:27.253888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:27.268400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:27.268905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:27.269389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:27.270143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:27.270599 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:27.271204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:27.420855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:27.428828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9d4ac57a-de44-4261-a923-fcfa3e1dfc88 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.194628 Sep 08 19:54:27.429991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 48/101] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:27 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:27.434768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:27.435533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:27.442476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:27.442984 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:27.443408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:27.444608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:27.444608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:27.444989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:27.482518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:27.494035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7e1a8aab-4c70-4876-8591-65187d43eba7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.245796 Sep 08 19:54:27.494598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 54/102] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:27 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:27.592932 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:27.600666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1d852921-493a-4e02-947a-442c789e0f0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.169440 Sep 08 19:54:27.601234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 49/103] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:27 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:28.457048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:28.458475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:28.468385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:28.469175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:28.473944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:28.474695 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:28.475173 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:28.475608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:28.523359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:28.530987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:28.545516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:28.546016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:28.546696 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:28.547544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:28.548197 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:28.548809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:28.641016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:28.649135 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-dcff95b7-7481-4904-b0ee-8085d5b340d1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.200918 Sep 08 19:54:28.649712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 55/104] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:28 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:28.654784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:28.655643 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:28.661832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:28.662545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:28.663082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:28.663982 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:28.664626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:28.665111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:28.699798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:28.708152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-26b4ccb8-add0-434d-bef3-115079ff43fe tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.191683 Sep 08 19:54:28.709191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 50/105] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:28 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:28.800859 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:28.810220 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1574badc-e46b-4a5d-bca2-9df4148b40a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.159307 Sep 08 19:54:28.811495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 56/106] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:28 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:29.672446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:29.673047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:29.675308 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:29.680861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:29.681310 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:29.681742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:29.682435 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:29.682911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:29.683331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:29.733714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:29.734511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:29.741895 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:29.742556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:29.743250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:29.744130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:29.744718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:29.745806 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:29.820108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:29.827492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-13de4c0b-b3c3-4f5c-a94e-fc25c11f03b4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.159044 Sep 08 19:54:29.828256 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 51/107] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:29 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:29.832807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:29.833420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:29.839130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:29.839800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:29.840227 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:29.840898 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:29.841505 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:29.841919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:29.884507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:29.892558 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1f8dab0f-e762-4d7c-abe8-56550dd8ca84 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.165318 Sep 08 19:54:29.893106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 57/108] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:29 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:29.971345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:29.979180 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3418c000-8871-4376-9c1b-c440bb47b670 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.149824 Sep 08 19:54:29.979747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 52/109] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:29 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:30.850010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:30.850670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:30.857111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:30.857601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:30.858076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:30.858795 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:30.859247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:30.859698 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:30.914892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:30.915511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:30.921737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:30.922246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:30.922687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:30.923399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:30.923849 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:30.924243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:30.994977 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:31.003958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fb5a5a4c-03e0-420e-992f-891c31b02b91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.157766 Sep 08 19:54:31.004542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 58/110] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:30 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:31.009362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:31.010040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:31.016065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:31.016571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:31.017170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:31.017865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:31.018317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:31.018767 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:31.054284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:31.062323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7784090d-d0ba-4061-a713-13ed155cf96e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.151223 Sep 08 19:54:31.062843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 53/111] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:30 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:31.151862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:31.160696 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7b710d6c-51ed-4602-a543-52193c342ec3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.155157 Sep 08 19:54:31.161383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 59/112] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:31 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:32.031457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:32.032453 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:32.043004 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:32.043813 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:32.044578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:32.045722 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:32.046483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:32.047221 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:32.084750 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:32.085437 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:32.091790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:32.092499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:32.092965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:32.093654 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:32.094102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:32.094667 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:32.196723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:32.204907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0d5f5876-3d43-44f4-9a82-5cc0a0a5297a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.179987 Sep 08 19:54:32.205708 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 54/113] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:32 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:32.222805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:32.223595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:32.229487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:32.229972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:32.230413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:32.231145 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:32.231602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:32.232013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:32.241014 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:32.248727 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-32b20e74-fd9d-4bbe-ab01-3cbcc6400ce7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.167855 Sep 08 19:54:32.249293 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 60/114] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:32 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:32.367324 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:32.378452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fc30dee2-c91d-497b-8641-4af6882dc556 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.159367 Sep 08 19:54:32.379031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 55/115] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:32 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:33.227729 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:33.228426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:33.234664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:33.235257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:33.235684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:33.236448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:33.236934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:33.237425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:33.272974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:33.273553 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:33.279835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:33.280367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:33.280869 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:33.281569 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:33.282000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:33.282435 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:33.372441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:33.381053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-505c9194-c086-452a-89df-8ba7c4342515 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.157246 Sep 08 19:54:33.397195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 61/116] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:33 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:33.403019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:33.403717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:33.409991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:33.410547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:33.411074 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:33.411832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:33.412352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:33.412819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:33.418776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:33.426435 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e6da953e-4b81-4b00-9ac0-2017f8be5165 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.157262 Sep 08 19:54:33.427118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 56/117] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:33 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:33.543903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:33.555995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-72865417-fcf9-49a9-91fb-6aa0fa7cbae8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.156480 Sep 08 19:54:33.556782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 62/118] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:33 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:34.405252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:34.405864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:34.412080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:34.412595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:34.413031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:34.413731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:34.414183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:34.414604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:34.449076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:34.449700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:34.456036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:34.456514 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:34.456944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:34.457632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:34.458074 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:34.458488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:34.543586 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:34.552919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6d4977bf-bc84-4cc1-8899-2254e616dc57 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.151476 Sep 08 19:54:34.553514 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 57/119] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:34 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:34.579976 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:34.580625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:34.584949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:34.586737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:34.587247 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:34.587672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:34.588367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:34.588818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:34.589242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:34.593070 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cbaf953c-8f76-4483-96ef-4026cd250668 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.147812 Sep 08 19:54:34.593629 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 63/120] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:34 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:34.719411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:34.731367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fb39b3ad-113d-45a2-91c1-2b9cd1dcadff tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.154954 Sep 08 19:54:34.732207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 58/121] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:34 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:35.579766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:35.581098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:35.591920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:35.592794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:35.593237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:35.593936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:35.594398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:35.594856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:35.615546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:35.616124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:35.622300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:35.622834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:35.623272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:35.624070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:35.624641 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:35.625073 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:35.731924 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:35.739741 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d740cfa6-1b78-4df9-9049-37df22bd2dbe tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.166526 Sep 08 19:54:35.740525 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 64/122] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:35 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:35.757093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:35.758037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:35.760473 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:35.764144 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:35.764625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:35.765055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:35.765798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:35.766247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:35.766693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:35.771315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:35.781033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1009c0da-28e8-4a71-996c-c65920d147a2 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.169319 Sep 08 19:54:35.781809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 59/123] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:35 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:35.897565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:35.909851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0b5348d8-a332-4cff-95e0-cef62af367bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.158559 Sep 08 19:54:35.910577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 65/124] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:35 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:36.763825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:36.764493 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:36.771398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:36.771845 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:36.772274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:36.772983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:36.773428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:36.773843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:36.803634 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:36.804214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:36.810548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:36.811072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:36.811505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:36.812201 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:36.812619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:36.813259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:36.903924 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:36.912091 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7692b739-75f5-44c3-9f57-e879c80d1cc7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.152544 Sep 08 19:54:36.912623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 60/125] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:36 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:36.933363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:36.933971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:36.940266 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:36.940744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:36.941174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:36.941877 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:36.942323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:36.942768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:37.080531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:37.090454 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d789ec14-6ee1-4c98-82be-21b39776dd8e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.160986 Sep 08 19:54:37.091259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 61/126] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:36 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:37.120325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:37.128730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-53513dc9-9db7-481a-a96f-f6f22e3a00a5 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.328853 Sep 08 19:54:37.129309 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 66/127] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:36 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:37.939178 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:37.940212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:37.950387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:37.951259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:37.951985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:37.953096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:37.953842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:37.954542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:38.095663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:38.103764 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0b89ec7a-dfbb-4735-b417-e265a1055504 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.171100 Sep 08 19:54:38.104349 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 62/128] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:37 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:38.113418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:38.114058 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:38.120391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:38.120874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:38.121299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:38.121969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:38.122423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:38.122867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:38.151410 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:38.152037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:38.158617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:38.159133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:38.159566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:38.160259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:38.160706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:38.161112 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:38.270191 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:38.278370 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-044e9f8c-5e98-4c74-b314-5e4a44be5068 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.168995 Sep 08 19:54:38.278901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 67/129] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:38 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:38.296580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:38.304239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9f44d3ad-0167-4cba-aece-e6453a2d93b1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.156637 Sep 08 19:54:38.304800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 63/130] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:38 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:39.130845 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:39.131639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:39.141433 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:39.141915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:39.142347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:39.143063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:39.143507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:39.143922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:39.284254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:39.286922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:39.293343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bbe5a81d-3900-4e38-ac8f-695c54598ff3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.169515 Sep 08 19:54:39.302672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 68/131] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:39 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:39.303010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:39.303010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:39.309964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:39.309964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:39.309964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:39.309964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:39.310396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:39.310396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:39.329063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:39.329670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:39.344684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:39.345195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:39.345621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:39.346310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:39.346780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:39.347198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:39.444795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:39.452671 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-af0c91d0-bd76-4ee0-9eb1-847700b188ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.155665 Sep 08 19:54:39.453280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 64/132] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:39 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:39.474272 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:39.481882 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7e0b412b-c655-44e7-b18b-daaa2afc801b tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.157214 Sep 08 19:54:39.482435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 69/133] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:39 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:40.323252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:40.324223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:40.339142 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:40.339992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:40.341289 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:40.342461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:40.343254 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:40.344009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:40.474941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:40.475501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:40.481755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:40.482247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:40.482681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:40.483390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:40.483856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:40.484331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:40.487430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:40.495188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ba63cb95-1160-4a5d-97f0-08e7996e34bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.180888 Sep 08 19:54:40.495762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 65/134] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:40 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:40.503989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:40.504729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:40.510983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:40.511558 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:40.512052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:40.512809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:40.513259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:40.513676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:40.614045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:40.622792 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3fea948e-f67e-44f1-b0d6-35fd3049b75d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.151830 Sep 08 19:54:40.623324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 70/135] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:40 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:40.645759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:40.653599 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4172d4ed-5c3e-4e4b-9156-5ad547e07b0d tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.153374 Sep 08 19:54:40.654136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 66/136] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:40 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:41.517423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:41.517994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:41.524710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:41.525191 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:41.525652 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:41.526308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:41.526790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:41.527209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:41.646468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:41.647066 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:41.653751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:41.654244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:41.654673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:41.655437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:41.655877 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:41.656445 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:41.663862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:41.671798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4a4fa3f5-8e74-4a05-84a7-a46b1fbf1d4b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.158209 Sep 08 19:54:41.672436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 71/137] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:41 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:41.676869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:41.677533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:41.683171 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:41.683715 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:41.684202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:41.684944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:41.685452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:41.685933 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:41.790078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:41.798394 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f1beaa61-f1ac-467d-a425-87067afb10a7 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.156816 Sep 08 19:54:41.799407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 67/138] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:41 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:41.821864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:41.829556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-98eefba0-bfa3-4b32-ba51-35f248675b48 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.156157 Sep 08 19:54:41.830120 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 72/139] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:41 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:42.694613 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:42.695319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:42.702918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:42.703542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:42.703975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:42.704749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:42.705122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:42.705527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:42.821164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:42.821747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:42.827978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:42.828605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:42.829040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:42.829735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:42.830186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:42.830601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:42.844584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:42.853636 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fb87e6f5-adb8-4730-8a84-9e6c3afcc282 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.163518 Sep 08 19:54:42.854137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 68/140] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:42 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:42.859183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:42.859814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:42.866034 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:42.866736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:42.867286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:42.868150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:42.868687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:42.869277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:42.977833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:42.986670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6df2659c-22f8-44eb-b7e0-8cb08a30f381 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.169436 Sep 08 19:54:42.987703 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 73/141] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:42 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:43.004771 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:43.014717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f657dac0-6938-4133-96ba-d1c3f5363339 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.159336 Sep 08 19:54:43.015819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 69/142] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:42 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:43.412124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-6bec486f-e4ee-4f8b-8f1c-a70bb9b8d0d6 req-c3aab57b-7e85-472d-8053-41933cd8d33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a136ee37-8423-41cc-93ff-f41b65bcef44", "name": "network-vif-plugged", "status": "completed", "tag": "fefd716b-9140-4570-909b-43c5c9b1e2cd"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:43.421633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6bec486f-e4ee-4f8b-8f1c-a70bb9b8d0d6 req-c3aab57b-7e85-472d-8053-41933cd8d33e service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:43.422179 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6bec486f-e4ee-4f8b-8f1c-a70bb9b8d0d6 req-c3aab57b-7e85-472d-8053-41933cd8d33e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:43.422607 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6bec486f-e4ee-4f8b-8f1c-a70bb9b8d0d6 req-c3aab57b-7e85-472d-8053-41933cd8d33e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:43.437094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-6bec486f-e4ee-4f8b-8f1c-a70bb9b8d0d6 req-c3aab57b-7e85-472d-8053-41933cd8d33e service nova] Creating event network-vif-plugged:fefd716b-9140-4570-909b-43c5c9b1e2cd for instance a136ee37-8423-41cc-93ff-f41b65bcef44 on hv-cinder-83124 Sep 08 19:54:43.442670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-6bec486f-e4ee-4f8b-8f1c-a70bb9b8d0d6 req-c3aab57b-7e85-472d-8053-41933cd8d33e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088707 Sep 08 19:54:43.443276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 74/143] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:43.876586 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:43.877218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:43.883203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:43.883680 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:43.884106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:43.884781 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:43.885214 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:43.885626 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:44.010343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:44.011096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:44.013791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:44.017655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:44.018144 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:44.018579 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:44.019355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:44.019844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:44.020266 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:44.021662 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-934c3aa4-782e-4b90-b608-44b9b79fec3b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.149402 Sep 08 19:54:44.022242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 70/144] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:43 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:44.037034 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:44.037637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:44.043726 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:44.044113 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:44.044542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:44.045228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:44.045674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:44.046097 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:44.150726 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:44.158705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a8d630b6-0c06-437a-8c3e-ebbdf89f64eb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.152449 Sep 08 19:54:44.159319 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 75/145] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:44 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:44.179625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:44.187412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-366ca5b3-63ee-41b5-a3d5-8f52e6ec2858 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.154019 Sep 08 19:54:44.187972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 71/146] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:44 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:45.044574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:45.045175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:45.051652 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:45.052141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:45.052581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:45.053273 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:45.053730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:45.054153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:45.181453 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:45.182034 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:45.187095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:45.188335 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:45.188826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:45.189256 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:45.189943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:45.190389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:45.190835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:45.194931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4d88e615-b4c4-4288-b2f0-9b7ed5405511 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.154406 Sep 08 19:54:45.195602 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 76/147] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:45 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:45.209773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:45.210552 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:45.216844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:45.217334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:45.217770 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:45.218466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:45.218992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:45.219416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:45.318475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:45.326355 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-729478e7-e290-47bf-952a-52744460afce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.148778 Sep 08 19:54:45.326965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 72/148] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:45 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:45.350098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:45.357940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-969262b5-eeb5-4b1a-9080-a1b19ad76bb9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.151969 Sep 08 19:54:45.358513 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 77/149] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:45 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:46.217495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:46.218096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:46.224494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:46.224975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:46.225407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:46.226092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:46.226537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:46.226985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:46.349414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:46.350061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:46.356393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:46.356886 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:46.357315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:46.358025 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:46.358462 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:46.358912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:46.370216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:46.379020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a77b46d6-c95b-400f-a54b-067705e18b1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.165345 Sep 08 19:54:46.379629 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 73/150] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:46 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:46.383982 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:46.384595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:46.391105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:46.391590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:46.392072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:46.392759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:46.393408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:46.393833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:46.488931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:46.496649 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-59d75f70-fa58-4462-957e-389302f3e421 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.151159 Sep 08 19:54:46.497231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 78/151] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:46 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:46.525251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:46.534552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-26535575-e9c9-45a5-ac06-134c1c6c2d07 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.154011 Sep 08 19:54:46.535161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 74/152] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:46 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:47.402419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:47.403039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:47.409608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.410095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.410542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.411308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.411963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.412542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.519487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:47.520082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:47.526229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.526761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.527186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.527877 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.528329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.528749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.558451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:47.566457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5c1f9ab3-af35-47d7-8643-d4e10131c005 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.168064 Sep 08 19:54:47.567054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 79/153] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:47 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:47.571664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:47.572244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:47.578207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.578694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.579166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.579840 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.580281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.580696 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.656340 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:47.665460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-93802262-c67d-4eb4-8725-9bdbde82daa3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.149806 Sep 08 19:54:47.666041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 75/154] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:47 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:47.707832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:47.715758 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7effeb14-1534-4142-96bb-6e7df6a2fd80 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.147740 Sep 08 19:54:47.716327 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 80/155] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:47 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:47.922780 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-ae5fb26b-3d75-438a-ad1a-8d9c78dae2ac req-fc2030e9-e4f3-4654-a142-087abfc8c7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f740383-c694-46e4-adea-1b308e00014e", "name": "network-vif-plugged", "status": "completed", "tag": "f448e2c8-6562-498b-8c79-0c3b9eded991"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:47.933911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-ae5fb26b-3d75-438a-ad1a-8d9c78dae2ac req-fc2030e9-e4f3-4654-a142-087abfc8c7d5 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:47.934391 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-ae5fb26b-3d75-438a-ad1a-8d9c78dae2ac req-fc2030e9-e4f3-4654-a142-087abfc8c7d5 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:47.934856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-ae5fb26b-3d75-438a-ad1a-8d9c78dae2ac req-fc2030e9-e4f3-4654-a142-087abfc8c7d5 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:47.946312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-ae5fb26b-3d75-438a-ad1a-8d9c78dae2ac req-fc2030e9-e4f3-4654-a142-087abfc8c7d5 service nova] Creating event network-vif-plugged:f448e2c8-6562-498b-8c79-0c3b9eded991 for instance 6f740383-c694-46e4-adea-1b308e00014e on hv-cinder-83124 Sep 08 19:54:47.951412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-ae5fb26b-3d75-438a-ad1a-8d9c78dae2ac req-fc2030e9-e4f3-4654-a142-087abfc8c7d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032274 Sep 08 19:54:47.952015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 76/156] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:48.589210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:48.589821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:48.595953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:48.596433 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:48.596866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:48.597664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:48.598115 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:48.598530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:48.688571 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:48.689300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:48.695680 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:48.696157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:48.696584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:48.697976 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:48.698695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:48.699182 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:48.720105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:48.748479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:48.757189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e561a261-5080-442b-a3f6-104f8e38cca9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.172261 Sep 08 19:54:48.757779 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 81/157] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:48 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:48.764942 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:48.765596 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:48.775243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:48.775734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:48.776208 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:48.777239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:48.777785 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:48.778350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:48.869709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:48.878148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6a40349b-9cbb-4a6f-8a03-2aa79192da25 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.193900 Sep 08 19:54:48.878738 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 77/158] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:48 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:48.920085 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:48.927920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ba0f0324-1297-4e78-b77b-f42f9f6537b7 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.169153 Sep 08 19:54:48.928470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 82/159] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:48 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:49.784709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:49.785271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:49.792349 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:49.792883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:49.793472 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:49.794672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:49.795209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:49.795678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:49.900609 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:49.901245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:49.907598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:49.908096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:49.908528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:49.909233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:49.909682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:49.910101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:49.933694 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:49.942096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cefdc524-485a-4779-b094-92adb7e9a36f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.161830 Sep 08 19:54:49.943042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 78/160] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:49 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:49.950031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:49.950876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:49.957819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:49.958513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:49.959468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:49.960168 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:49.960611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:49.961024 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:50.045372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:50.054022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-64cebfbb-aa04-49c0-aecd-0683e9ceec9f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.157243 Sep 08 19:54:50.054587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 83/161] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:49 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:50.087937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:50.095632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c95e0252-43fd-40b2-b736-e8a2168ec330 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.149232 Sep 08 19:54:50.096182 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 79/162] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:49 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:50.965002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:50.966128 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:50.972786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:50.973277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:50.973709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:50.974440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:50.974915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:50.975495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:51.077342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:51.078583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:51.085201 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:51.085725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:51.086158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:51.086879 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:51.087327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:51.087769 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:51.110150 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:51.118180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b5d022d2-ee46-41c3-b95d-003713a6c158 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.157368 Sep 08 19:54:51.119049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 84/163] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:50 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:51.123506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:51.124107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:51.130678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:51.131160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:51.131593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:51.132280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:51.132729 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:51.133146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:51.216725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:51.224780 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-553f8d52-1eca-4ff0-b0ee-4052127b92e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.151663 Sep 08 19:54:51.225383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 80/164] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:51 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:51.259395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:51.267345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a0af90a9-f34e-44e0-9e69-9765cd9832eb tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.147345 Sep 08 19:54:51.267952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 85/165] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:51 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:52.141082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:52.141686 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:52.147955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:52.148447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:52.148882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:52.149570 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:52.150017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:52.150441 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:52.247534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:52.248139 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:52.255048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:52.255438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:52.255868 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:52.256530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:52.256970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:52.257381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:52.260079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:52.280191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:52.288184 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b1be76a0-af68-44bf-802f-d9d426e99913 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.150972 Sep 08 19:54:52.288741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 81/166] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:52 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:52.294931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:52.295546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:52.303767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:52.304294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:52.304685 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:52.305409 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:52.305860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:52.306290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:52.389568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:52.397953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9c0367c6-c211-471c-b301-b59585936f5d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.154453 Sep 08 19:54:52.398719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 86/167] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:52 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:52.437593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:52.448477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cf0c9f2b-c5cc-4e02-8458-dc0d11c553ec tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.157177 Sep 08 19:54:52.449066 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 82/168] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:52 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:53.314945 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:53.315826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:53.326020 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:53.326856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:53.327622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:53.328754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:53.329542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:53.329962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:53.421174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:53.421800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:53.428216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:53.428697 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:53.429144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:53.429829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:53.430273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:53.430698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:53.469478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:53.477457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5dee8ab5-e58f-4bcc-9eb3-593029e4f5ba tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.169093 Sep 08 19:54:53.478396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 87/169] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:53 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:53.484038 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:53.484640 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:53.499014 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:53.499512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:53.499955 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:53.500732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:53.501630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:53.502059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:53.560713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:53.568735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-346582d0-2e40-489f-b1cd-22d985395dbd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.151272 Sep 08 19:54:53.569345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 83/170] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:53 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:53.636450 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:53.649854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-67ebc651-9cf1-4903-a26c-34761d79ec1e tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.169029 Sep 08 19:54:53.650679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 88/171] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:53 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:54.500700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:54.501747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:54.507945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:54.508422 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:54.508851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:54.509531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:54.509978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:54.510390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:54.592235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:54.592845 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:54.599119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:54.599606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:54.600049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:54.600743 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:54.601194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:54.601613 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:54.636609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:54.644504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0a2fc0f5-9f4b-4922-978b-59c40f953408 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.147864 Sep 08 19:54:54.645070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 84/172] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:54 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:54.675158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:54.675843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:54.681751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:54.682231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:54.682666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:54.683366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:54.683814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:54.684234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:54.745364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:54.753757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a7a91e30-8c32-478c-95be-a0931216816e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.165474 Sep 08 19:54:54.754326 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 89/173] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:54 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:54.823005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:54.830950 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ba252ab1-2558-4695-81c9-194751de54af tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.159666 Sep 08 19:54:54.831452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 85/174] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:54 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:55.667737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:55.668886 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:55.677383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:55.677884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:55.678392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:55.679045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:55.679502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:55.681543 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:55.776481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:55.777948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:55.799252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:55.799947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:55.801187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:55.804762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:55.805578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:55.806314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:55.903679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:55.911529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-408f1ca5-f05e-456e-8154-15f0803b57a4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.248431 Sep 08 19:54:55.912537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 90/175] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:55 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:55.921030 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:55.922019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:55.934941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:55.935747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:55.936367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:55.937317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:55.938252 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:55.942311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:56.092826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:56.115959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-93ec103f-d2fd-4101-bdb6-4997318fb97b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1366 microversion: 2.1 time: 0.343994 Sep 08 19:54:56.134098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 86/176] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:55 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:56.239628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:56.264380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-deac4d23-492c-47a6-a353-77a820d438a1 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1315 microversion: 2.1 time: 0.344776 Sep 08 19:54:56.265046 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 91/177] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:55 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:56.533661 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-7b701831-0ecf-4433-ad56-de6740ce2834 req-c5cc7465-5776-4f41-9b92-a54f6047acf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22bff83-6076-4522-87b8-762a5ee75a3f", "name": "network-vif-plugged", "status": "completed", "tag": "aa0a5896-bbc1-43fe-818e-f9d2e827cbaa"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:56.539951 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=80 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:56.545991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7b701831-0ecf-4433-ad56-de6740ce2834 req-c5cc7465-5776-4f41-9b92-a54f6047acf0 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:56.546760 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7b701831-0ecf-4433-ad56-de6740ce2834 req-c5cc7465-5776-4f41-9b92-a54f6047acf0 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:56.547343 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7b701831-0ecf-4433-ad56-de6740ce2834 req-c5cc7465-5776-4f41-9b92-a54f6047acf0 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:56.562226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-7b701831-0ecf-4433-ad56-de6740ce2834 req-c5cc7465-5776-4f41-9b92-a54f6047acf0 service nova] Creating event network-vif-plugged:aa0a5896-bbc1-43fe-818e-f9d2e827cbaa for instance c22bff83-6076-4522-87b8-762a5ee75a3f on hv-cinder-83124 Sep 08 19:54:56.569943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-7b701831-0ecf-4433-ad56-de6740ce2834 req-c5cc7465-5776-4f41-9b92-a54f6047acf0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040232 Sep 08 19:54:56.571079 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 87/178] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:56.937787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:56.938618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:56.945859 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=80 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:54:56.956427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:56.956945 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:56.957379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:56.958100 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:56.958546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:56.959210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.145672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:57.146547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:57.166548 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:57.167944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:57.169319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.172698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:57.173448 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:57.174019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.205169 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:57.216364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-862ec9d1-3ee2-4215-b882-bbabc0821467 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.284548 Sep 08 19:54:57.217002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 92/179] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:56 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:57.297484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:57.300025 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:57.306395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:57.306900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:57.307522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.308378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:57.308981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:57.309559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.357884 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:57.371464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7a445bf2-2604-4e0f-81cf-a348652864ee tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1556 microversion: 2.1 time: 0.230659 Sep 08 19:54:57.372809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 88/180] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:57 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:54:57.410300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:57.412989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:57.423894 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:57.427853 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:57.428290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.429006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:57.429452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:57.429867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:57.565210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:57.574404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f008f91f-e093-4975-b874-a49bffb7ecea tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1501 microversion: 2.1 time: 0.288103 Sep 08 19:54:57.575015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 93/181] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:57 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1501 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:57.678471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6f3ae4f1-5986-4a41-a63f-839a9616c7bd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.275489 Sep 08 19:54:57.679536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 89/182] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 19:54:57 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-interface => generated 285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:58.241473 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:58.242264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:58.255123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:58.255123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:58.258217 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:58.259349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:58.260015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:58.265214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:58.445921 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:58.454977 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-664267a1-7c8e-4a5a-b138-9eeaaa497840 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.218305 Sep 08 19:54:58.465668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 94/183] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:58 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:54:59.351809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-7d907f76-1529-4620-a134-adf76dd6c56a req-79ef2640-e155-4f3b-a7b9-f05dd4be9789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f740383-c694-46e4-adea-1b308e00014e", "tag": "f448e2c8-6562-498b-8c79-0c3b9eded991"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:54:59.362564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7d907f76-1529-4620-a134-adf76dd6c56a req-79ef2640-e155-4f3b-a7b9-f05dd4be9789 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:59.363103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7d907f76-1529-4620-a134-adf76dd6c56a req-79ef2640-e155-4f3b-a7b9-f05dd4be9789 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:59.363532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7d907f76-1529-4620-a134-adf76dd6c56a req-79ef2640-e155-4f3b-a7b9-f05dd4be9789 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:59.374291 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-7d907f76-1529-4620-a134-adf76dd6c56a req-79ef2640-e155-4f3b-a7b9-f05dd4be9789 service nova] Creating event network-changed:f448e2c8-6562-498b-8c79-0c3b9eded991 for instance 6f740383-c694-46e4-adea-1b308e00014e on hv-cinder-83124 Sep 08 19:54:59.381087 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-7d907f76-1529-4620-a134-adf76dd6c56a req-79ef2640-e155-4f3b-a7b9-f05dd4be9789 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033906 Sep 08 19:54:59.381691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 90/184] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:54:59.487435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:54:59.488251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:54:59.494475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:59.495001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:59.495443 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:59.496134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:54:59.496590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:54:59.497008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:54:59.629094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:54:59.637222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3ceb6e9c-5f42-4977-aa57-af9e2527c63b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.153647 Sep 08 19:54:59.637981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 95/185] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:54:59 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:00.678058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:00.681037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:00.688225 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:00.688799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:00.689297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:00.690033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:00.690871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:00.691455 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:00.868867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:00.878197 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3d6ce9ae-dfe5-48e1-ae5e-7efde0b31ae0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.219148 Sep 08 19:55:00.879008 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 91/186] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:00 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:01.900860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:01.901489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:01.907398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:01.907947 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:01.908369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:01.909043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:01.909477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:01.909891 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:02.038791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:02.046394 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0a015b2f-8548-4264-b18b-256313cadc1c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.149360 Sep 08 19:55:02.046996 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 96/187] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:01 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:03.068987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:03.070729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:03.085535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:03.086304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:03.087082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:03.087917 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:03.088459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:03.089027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:03.236358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:03.244386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-22bf08e8-e7d2-49d8-8ebc-b5d34f5caabc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.179396 Sep 08 19:55:03.244928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 92/188] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:03 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:04.267577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:04.268178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:04.274605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:04.275128 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:04.275563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:04.276251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:04.276705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:04.277127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:04.433562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:04.441424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-540e1abb-2459-461d-b608-3d6e0cc68c6f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.177664 Sep 08 19:55:04.441990 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 97/189] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:04 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:05.466881 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:05.467687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:05.474557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:05.475071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:05.475511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:05.476205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:05.476655 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:05.477099 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:05.605217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:05.613356 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-691b518a-4622-46cf-8039-313d6e558e1f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.152488 Sep 08 19:55:05.613911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 93/190] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:05 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:06.642102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:06.642739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:06.648986 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:06.649651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:06.650075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:06.650894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:06.651347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:06.651764 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:06.868492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:06.876948 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-79092610-f952-4545-b6b4-4fc7c37d745a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1362 microversion: 2.1 time: 0.238590 Sep 08 19:55:06.877536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 98/191] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:06 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:07.902770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:07.903607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:07.913025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:07.913517 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:07.913946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:07.914651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:07.915136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:07.915559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:08.048671 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:08.056643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d5634715-2958-40fd-921e-64df85d15f90 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1548 microversion: 2.1 time: 0.160524 Sep 08 19:55:08.057244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 94/192] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:07 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:08.080864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:08.081413 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:08.087869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:08.088349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:08.088776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:08.089454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:08.089900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:08.090312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:08.212529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a6686eb2-9bc2-4b59-9624-78f630e33789 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136710 Sep 08 19:55:08.213457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 99/193] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 19:55:08 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:08.798476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba93eaad-2bf4-45c8-87b5-b62e962fdb74"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:08.801181 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:08.807574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:08.808239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:08.809008 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:08.810001 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:08.810843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:08.811539 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:08.831737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:09.171709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8ebcebb2-1f46-4cd6-a5fe-83e6b94c9e62 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "POST /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377069 Sep 08 19:55:09.173027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 95/194] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:55:08 2022] POST /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:09.533360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-2d7e8b58-e8c8-450f-8778-746876145fa5 req-f491688a-d37f-40c4-8920-a3e1b0b06684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c22bff83-6076-4522-87b8-762a5ee75a3f", "tag": "aa0a5896-bbc1-43fe-818e-f9d2e827cbaa"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:09.545112 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-2d7e8b58-e8c8-450f-8778-746876145fa5 req-f491688a-d37f-40c4-8920-a3e1b0b06684 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:09.546225 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-2d7e8b58-e8c8-450f-8778-746876145fa5 req-f491688a-d37f-40c4-8920-a3e1b0b06684 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:09.546851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-2d7e8b58-e8c8-450f-8778-746876145fa5 req-f491688a-d37f-40c4-8920-a3e1b0b06684 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:09.562508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-2d7e8b58-e8c8-450f-8778-746876145fa5 req-f491688a-d37f-40c4-8920-a3e1b0b06684 service nova] Creating event network-changed:aa0a5896-bbc1-43fe-818e-f9d2e827cbaa for instance c22bff83-6076-4522-87b8-762a5ee75a3f on hv-cinder-83124 Sep 08 19:55:09.576494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-2d7e8b58-e8c8-450f-8778-746876145fa5 req-f491688a-d37f-40c4-8920-a3e1b0b06684 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046662 Sep 08 19:55:09.577318 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 100/195] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:23.868562 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-702641307", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "networks": [{"uuid": "33bec98c-f840-46f9-8bff-4455204420bb"}]}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:23.878123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=17 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:23.878835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:23.928140 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] validate_networks() for [('33bec98c-f840-46f9-8bff-4455204420bb', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:55:24.235524 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:24.236123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:24.238419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=17 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:24.239024 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=83 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:24.247251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:24.247761 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:24.250121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:24.251250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:24.251913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:24.252543 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:24.283160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 19:55:24.332498 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:55:24.332862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:55:24.333717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:55:24.334412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:55:24.334913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:55:24.345905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:24.346510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:24.347187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:24.348023 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:24.348676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:24.349287 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:24.378632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Getting quotas for project 6389fd3572944faa978a04858d885678. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:55:24.383921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Getting quotas for user 4e868e46796645fd85ee3f295d85c5f1 and project 6389fd3572944faa978a04858d885678. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:55:24.397137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:55:24.399959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:55:24.412274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5555107a-33a6-4895-91b1-45c82ce470c4 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 204 len: 0 microversion: 2.1 time: 0.180726 Sep 08 19:55:24.412866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 101/196] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 19:55:24 2022] DELETE /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 19:55:24.422130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:24.422950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:24.428991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:24.429622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:24.430065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:24.430947 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:24.431625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:24.432186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:24.457303 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2b4462f2-a0be-41ec-8858-c65bf830ea69 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592827 Sep 08 19:55:24.463856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 96/197] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:55:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:55:24.470676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5c49ba51-2fc5-427e-afdf-dece75e61b6a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:24.471513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5c49ba51-2fc5-427e-afdf-dece75e61b6a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:24.565804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5c49ba51-2fc5-427e-afdf-dece75e61b6a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:24.576227 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5c49ba51-2fc5-427e-afdf-dece75e61b6a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1213 microversion: 2.1 time: 0.110827 Sep 08 19:55:24.576829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 97/198] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:24 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:24.677718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:24.687275 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d76091c0-70d5-4feb-9532-53f8f729d778 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1553 microversion: 2.1 time: 0.269456 Sep 08 19:55:24.687850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 102/199] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:24 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:25.599698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:25.600356 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:25.607627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:25.608156 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:25.608603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:25.609259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:25.609759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:25.610378 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:25.672584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:25.696384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ecfe30a8-ad17-41d1-a208-a35e10476361 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1217 microversion: 2.1 time: 0.100549 Sep 08 19:55:25.698299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 98/200] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:25 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:25.720797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:25.721426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:25.727824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:25.728535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:25.728981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:25.729780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:25.730496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:25.731012 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:25.899040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:25.907699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-64dcdcb7-80ca-45b8-9e09-79e624c26ce0 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1553 microversion: 2.1 time: 0.192981 Sep 08 19:55:25.908289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 103/201] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:25 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:26.721524 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:26.722120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:26.732141 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:26.732747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:26.733466 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:26.734737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:26.735252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:26.736699 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:26.831805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:26.843194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c3ca7f29-eebd-4c3c-8453-f06d59b6a701 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1265 microversion: 2.1 time: 0.125393 Sep 08 19:55:26.844290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 99/202] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:26 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:26.931374 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:26.932279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:26.938416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:26.938937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:26.939357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:26.940050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:26.940497 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:26.940939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:27.149646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:27.167455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8f9aab89-5c8e-4ca3-9933-6d95a77d6b1a tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1553 microversion: 2.1 time: 0.240482 Sep 08 19:55:27.168063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 104/203] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:26 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:27.867703 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:27.869517 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:27.880634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:27.881277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:27.882053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:27.882940 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:27.883520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:27.884121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:28.026442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-654187de-d017-41ff-a797-d35e56b79c5e req-8a06b9a6-36d7-4bd6-85c8-1cd6324f8063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a136ee37-8423-41cc-93ff-f41b65bcef44", "name": "network-vif-deleted", "tag": "fefd716b-9140-4570-909b-43c5c9b1e2cd"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:28.050785 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-654187de-d017-41ff-a797-d35e56b79c5e req-8a06b9a6-36d7-4bd6-85c8-1cd6324f8063 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:28.051674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-654187de-d017-41ff-a797-d35e56b79c5e req-8a06b9a6-36d7-4bd6-85c8-1cd6324f8063 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:28.052127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-654187de-d017-41ff-a797-d35e56b79c5e req-8a06b9a6-36d7-4bd6-85c8-1cd6324f8063 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:28.068612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-654187de-d017-41ff-a797-d35e56b79c5e req-8a06b9a6-36d7-4bd6-85c8-1cd6324f8063 service nova] Creating event network-vif-deleted:fefd716b-9140-4570-909b-43c5c9b1e2cd for instance a136ee37-8423-41cc-93ff-f41b65bcef44 on hv-cinder-83124 Sep 08 19:55:28.082925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-654187de-d017-41ff-a797-d35e56b79c5e req-8a06b9a6-36d7-4bd6-85c8-1cd6324f8063 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060516 Sep 08 19:55:28.086214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 105/204] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:55:28.192176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:28.193100 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:28.213245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:28.214029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:28.214652 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:28.215501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:28.216091 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:28.216648 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:28.247918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:28.258613 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c6f3196a-fa23-4d06-ad42-628606012e9a tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.395508 Sep 08 19:55:28.260998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 100/205] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:27 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:28.367671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1087faee65634c22a59a6f6773e80484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '508edea792734bd89f391e57c49c614f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:28.381960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7bae8022-b531-4d5e-a244-06566cbe27d9 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 200 len: 1346 microversion: 2.1 time: 0.193777 Sep 08 19:55:28.386794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 106/206] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:28 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 1346 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:55:29.073385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-771a17a0-9417-4e58-bdc7-b8244c04350d req-099952cb-9d6e-4547-9f99-38273b8026f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0199af-610e-4426-a999-3a272d1bb15e", "tag": "06a65ca2-557f-4f54-baef-678f902c2d9a"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:29.100494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-771a17a0-9417-4e58-bdc7-b8244c04350d req-099952cb-9d6e-4547-9f99-38273b8026f7 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.101736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-771a17a0-9417-4e58-bdc7-b8244c04350d req-099952cb-9d6e-4547-9f99-38273b8026f7 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.103843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-771a17a0-9417-4e58-bdc7-b8244c04350d req-099952cb-9d6e-4547-9f99-38273b8026f7 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.127660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-771a17a0-9417-4e58-bdc7-b8244c04350d req-099952cb-9d6e-4547-9f99-38273b8026f7 service nova] Creating event network-changed:06a65ca2-557f-4f54-baef-678f902c2d9a for instance 9e0199af-610e-4426-a999-3a272d1bb15e on hv-cinder-83124 Sep 08 19:55:29.137756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-771a17a0-9417-4e58-bdc7-b8244c04350d req-099952cb-9d6e-4547-9f99-38273b8026f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068413 Sep 08 19:55:29.138875 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 101/207] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:29.283922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:29.285181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:29.293073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.293903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.297132 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.299383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.300201 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.301778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.406274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:29.407077 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:29.416698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.417198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.417634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.418338 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.418938 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.419235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.460286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] HTTP exception thrown: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Request method failure captured: Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 HTTP/1.1 Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhTN-o3eIWS1KT1TgKuPfQErfCfk9j_zsJoB6Lt6ru0med3zv0qR0rCypniMz04BpeG8ixjbQNEM9rEeHJ-w9n3nnV5JPVQ6LQHlNP1Z20xDyufnIqC9Z4xRhDClywAPT5GXaFc7Go_htAa-Il1ShZlmdgWDtLc-X8ivzuf_V5bygI Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:55:29.474194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_508edea792734bd89f391e57c49c614f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 1087faee65634c22a59a6f6773e80484 Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.475717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'a136ee37-8423-41cc-93ff-f41b65bcef44'} Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:55:29.476516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.477861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.480236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Returning 404 to user: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:55:29.481236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-621ff50c-6ba5-4170-a419-5b6e6598a7ad tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 404 len: 111 microversion: 2.1 time: 0.079574 Sep 08 19:55:29.485762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 102/208] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:29 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 19:55:29.644401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:29.654530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7cca523b-8c16-4092-a500-d18f3e273d95 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.374830 Sep 08 19:55:29.656491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 107/209] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:29 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:29.688242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:29.691148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:29.701777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.702428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.702904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.703888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:29.704949 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:29.705380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:29.732331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] HTTP exception thrown: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Request method failure captured: Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44/os-volume_attachments HTTP/1.1 Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhTN-o3eIWS1KT1TgKuPfQErfCfk9j_zsJoB6Lt6ru0med3zv0qR0rCypniMz04BpeG8ixjbQNEM9rEeHJ-w9n3nnV5JPVQ6LQHlNP1Z20xDyufnIqC9Z4xRhDClywAPT5GXaFc7Go_htAa-Il1ShZlmdgWDtLc-X8ivzuf_V5bygI Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:55:29.734018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_508edea792734bd89f391e57c49c614f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 1087faee65634c22a59a6f6773e80484 Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.735217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'server_id': 'a136ee37-8423-41cc-93ff-f41b65bcef44'} Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:55:29.735851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:29.736954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:29.738026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Returning 404 to user: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:55:29.738026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bc4ca547-fb33-4f31-92e5-6daa17d560ff tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052115 Sep 08 19:55:29.738026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 103/210] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 19:55:29 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:55:30.678483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:30.679913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:30.687189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:30.687983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:30.688622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:30.689418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:30.690118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:30.690675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:30.843361 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:30.852307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3a9bed7b-1560-4b22-bab2-aea29601e830 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.178290 Sep 08 19:55:30.852889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 108/211] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:30 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:30.987095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:30.988228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:30.996582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:30.997400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:30.998040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:30.999131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:30.999996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:31.001276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:31.037980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] HTTP exception thrown: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Request method failure captured: Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: DELETE /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 HTTP/1.1 Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhTN-o3eIWS1KT1TgKuPfQErfCfk9j_zsJoB6Lt6ru0med3zv0qR0rCypniMz04BpeG8ixjbQNEM9rEeHJ-w9n3nnV5JPVQ6LQHlNP1Z20xDyufnIqC9Z4xRhDClywAPT5GXaFc7Go_htAa-Il1ShZlmdgWDtLc-X8ivzuf_V5bygI Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:55:31.041063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_508edea792734bd89f391e57c49c614f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 1087faee65634c22a59a6f6773e80484 Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.042274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'a136ee37-8423-41cc-93ff-f41b65bcef44'} Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:55:31.042939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.043955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.045013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Returning 404 to user: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:55:31.045013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-60ad5df7-4f41-414d-9afb-186beda45101 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 404 len: 111 microversion: 2.1 time: 0.060757 Sep 08 19:55:31.045013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 104/212] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 19:55:30 2022] DELETE /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 19:55:31.053136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:31.053972 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] [instance: a136ee37-8423-41cc-93ff-f41b65bcef44] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:31.060923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:31.061740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:31.063228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:31.064333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:31.064953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:31.065684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:31.081264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] HTTP exception thrown: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Request method failure captured: Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 HTTP/1.1 Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhTN-o3eIWS1KT1TgKuPfQErfCfk9j_zsJoB6Lt6ru0med3zv0qR0rCypniMz04BpeG8ixjbQNEM9rEeHJ-w9n3nnV5JPVQ6LQHlNP1Z20xDyufnIqC9Z4xRhDClywAPT5GXaFc7Go_htAa-Il1ShZlmdgWDtLc-X8ivzuf_V5bygI Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:55:31.086502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_508edea792734bd89f391e57c49c614f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/508edea792734bd89f391e57c49c614f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 508edea792734bd89f391e57c49c614f Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-DeleteServersTestJSON-20912948 Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 1087faee65634c22a59a6f6773e80484 Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-DeleteServersTestJSON-20912948-project Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.088072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'a136ee37-8423-41cc-93ff-f41b65bcef44'} Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:55:31.088870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. Sep 08 19:55:31.090536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:55:31.091818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] Returning 404 to user: Instance a136ee37-8423-41cc-93ff-f41b65bcef44 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:55:31.091818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-425bad05-8243-4bbd-84a7-88202e123d90 tempest-DeleteServersTestJSON-20912948 tempest-DeleteServersTestJSON-20912948-project] 10.222.0.44 "GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44" status: 404 len: 111 microversion: 2.1 time: 0.039825 Sep 08 19:55:31.092896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 109/213] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:31 2022] GET /compute/v2.1/servers/a136ee37-8423-41cc-93ff-f41b65bcef44 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:55:31.874849 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:31.875453 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:31.887972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:31.888458 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:31.888894 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:31.889591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:31.893450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:31.894053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:32.205911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:32.214793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-641fd9a4-f501-49ad-9807-1c02a3875dab tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.343877 Sep 08 19:55:32.215539 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 105/214] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:31 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:33.243244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:33.244639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:33.254071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:33.254786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:33.256010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:33.256875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:33.257728 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:33.258299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:33.546532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:33.559352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e756d516-e856-4869-9036-82ddb0fb9fb6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.325792 Sep 08 19:55:33.561114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 110/215] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:33 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:34.583650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:34.584332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:34.586923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:34.589010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=8 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:34.594900 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:34.595708 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:34.596397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:34.597317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:34.598082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:34.598728 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:34.750117 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:34.759151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-516cf696-9b02-4c01-9210-c76ad7e90a0c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.179299 Sep 08 19:55:34.759831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 106/216] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:34 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:35.781704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:35.782900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:35.789569 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:35.790377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:35.791113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:35.792176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:35.792824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:35.793400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:35.955054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:35.963960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-50ff23f3-d47d-4074-a033-fc744e9f1b41 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.186287 Sep 08 19:55:35.964647 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 111/217] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:35 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:36.987518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:36.988909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:36.995880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:36.996373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:36.996861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:36.997568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:36.998021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:36.998437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:37.161569 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:37.170667 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-68dfc41c-0bbd-49ef-aee6-2b2242a46d76 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.187194 Sep 08 19:55:37.186194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 107/218] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:36 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:38.198860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:38.199476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:38.220458 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:38.220966 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:38.221406 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:38.222135 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:38.222591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:38.227035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:38.502773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:38.511164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-81c66ccd-95f8-4188-9e7c-7470338e01c2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.316558 Sep 08 19:55:38.511939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 112/219] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:38 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:39.533585 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:39.534193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:39.541263 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:39.541741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:39.542364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:39.543084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:39.543536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:39.543953 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:39.749330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:39.759601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-aaad61b4-c0b6-49db-afaf-e94684653267 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.229891 Sep 08 19:55:39.760223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 108/220] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:39 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:40.782202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:40.782978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:40.790016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:40.790763 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:40.791362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:40.792448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:40.792915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:40.793343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:40.938010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:40.946730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2566d12b-d6ba-41dd-a6ba-2bb6e9444645 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.168359 Sep 08 19:55:40.947367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 113/221] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:40 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:40.987390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-141954045", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:41.060403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] validate_networks() for [('f611bfd9-3041-4cde-9f7b-2bc9eb83eb6a', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:55:41.687131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:55:41.687795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:55:41.688421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:55:41.689151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:55:41.689578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:55:41.699487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:41.700088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:41.700616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:41.701630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:41.702211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:41.702773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:41.720718 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for project 933256f83bff41ff986dd79bd06a6b74. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:55:41.725424 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for user 628b75f16eb14ce1b7deed61ade28b9c and project 933256f83bff41ff986dd79bd06a6b74. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:55:41.737133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:55:41.739767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:55:41.790313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cbabf8c1-09a0-4c99-9604-56ca8aff26c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.931243 Sep 08 19:55:41.791495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 109/222] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:55:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 19:55:41.802495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e9581cff-831c-4d12-bf4f-03ceea3d5cc4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:41.803309 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e9581cff-831c-4d12-bf4f-03ceea3d5cc4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:41.893296 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e9581cff-831c-4d12-bf4f-03ceea3d5cc4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:41.902487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e9581cff-831c-4d12-bf4f-03ceea3d5cc4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1221 microversion: 2.1 time: 0.103817 Sep 08 19:55:41.903424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 114/223] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:41 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:41.971414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1694592932", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:41.971751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:41.972429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:41.983496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:41.984319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:41.985297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:41.986420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:41.987078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:41.987682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:42.049764 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] validate_networks() for [('f611bfd9-3041-4cde-9f7b-2bc9eb83eb6a', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:55:42.155961 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:42.165430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-72e3b817-6a6a-4005-95d4-a126deeed2a0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.199686 Sep 08 19:55:42.168002 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 110/224] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:41 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:42.485129 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:55:42.485389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:55:42.486060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:55:42.486520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:55:42.486931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:55:42.498270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:42.498864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:42.499492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:42.500797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:42.501310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:42.501738 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:42.523746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for project 933256f83bff41ff986dd79bd06a6b74. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:55:42.532569 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for user 628b75f16eb14ce1b7deed61ade28b9c and project 933256f83bff41ff986dd79bd06a6b74. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:55:42.558678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:55:42.558678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:55:42.621759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7db7b097-eaae-4805-a247-7b44081f8df3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.655823 Sep 08 19:55:42.623313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 115/225] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:55:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:55:42.636624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-255f67d9-31b3-4bae-9720-762735570a75 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:42.637337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-255f67d9-31b3-4bae-9720-762735570a75 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:42.710236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-255f67d9-31b3-4bae-9720-762735570a75 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:42.719984 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-255f67d9-31b3-4bae-9720-762735570a75 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1222 microversion: 2.1 time: 0.088123 Sep 08 19:55:42.721450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 111/226] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:42 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:43.189879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:43.190672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:43.198210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:43.198721 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:43.199165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:43.199858 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:43.200352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:43.200771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:43.406246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:43.431871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3e1676e8-8551-4ded-9634-958e0819c5a6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.246358 Sep 08 19:55:43.435911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 116/227] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:43 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:43.747953 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:43.749801 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:43.763205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:43.764277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:43.765007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:43.765895 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:43.766532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:43.767448 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:43.908967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:43.917669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1e832537-7c21-49b9-9f5b-cfd26cbfa1a0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1274 microversion: 2.1 time: 0.175514 Sep 08 19:55:43.918251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 112/228] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:43 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:44.457836 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:44.458464 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:44.476566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:44.480599 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:44.482531 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:44.485310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:44.487667 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:44.493535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:44.943222 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:44.945835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:44.961096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:44.962121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:44.962594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:44.965628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:44.966191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:44.967730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:45.023816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:45.031871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-22f1afea-8251-42f9-a6b5-5c362bd0e4b5 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.578306 Sep 08 19:55:45.037214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 117/229] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:44 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:45.074541 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:45.095024 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-86a0ac33-901c-4b5e-9dc3-a1a367662b08 req-011c8cc8-967a-4f5e-9e6f-f90b411518ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0199af-610e-4426-a999-3a272d1bb15e", "name": "network-vif-plugged", "status": "completed", "tag": "06a65ca2-557f-4f54-baef-678f902c2d9a"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:45.101831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-72248d99-026e-463c-9965-4d2262aff756 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1280 microversion: 2.1 time: 0.163817 Sep 08 19:55:45.102617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 113/230] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:44 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:55:45.120362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-86a0ac33-901c-4b5e-9dc3-a1a367662b08 req-011c8cc8-967a-4f5e-9e6f-f90b411518ef service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:45.121510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-86a0ac33-901c-4b5e-9dc3-a1a367662b08 req-011c8cc8-967a-4f5e-9e6f-f90b411518ef service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:45.122452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-86a0ac33-901c-4b5e-9dc3-a1a367662b08 req-011c8cc8-967a-4f5e-9e6f-f90b411518ef service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:45.137130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-86a0ac33-901c-4b5e-9dc3-a1a367662b08 req-011c8cc8-967a-4f5e-9e6f-f90b411518ef service nova] Creating event network-vif-plugged:06a65ca2-557f-4f54-baef-678f902c2d9a for instance 9e0199af-610e-4426-a999-3a272d1bb15e on hv-cinder-83124 Sep 08 19:55:45.143502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-86a0ac33-901c-4b5e-9dc3-a1a367662b08 req-011c8cc8-967a-4f5e-9e6f-f90b411518ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055190 Sep 08 19:55:45.144872 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 118/231] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:55:46.060013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:46.061060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:46.078455 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:46.079085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:46.083807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:46.084573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:46.088403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:46.090271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:46.129757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:46.141603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:46.164372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:46.169035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:46.169709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:46.173570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:46.175454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:46.178407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:46.225949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:46.623580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:46.639381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cb3bf7a6-363f-46d6-b77d-76f2eb769970 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1313 microversion: 2.1 time: 0.584976 Sep 08 19:55:46.640298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 114/232] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:46 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:46.697364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:46.706213 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f36a5942-5aa2-43c2-8109-a6acd3bf5c11 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.583485 Sep 08 19:55:46.723024 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 119/233] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:46 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:46.845106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-2095c1e4-009b-4fed-be9c-8609e8c93a8a req-208b9c98-30ad-4d32-bafb-0218ea78f714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59f3554-3121-47a3-8819-0763cdbc8c31", "tag": "7717f928-407f-44bf-be21-24013ca200b5"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:46.863762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-2095c1e4-009b-4fed-be9c-8609e8c93a8a req-208b9c98-30ad-4d32-bafb-0218ea78f714 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:46.864237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-2095c1e4-009b-4fed-be9c-8609e8c93a8a req-208b9c98-30ad-4d32-bafb-0218ea78f714 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:46.864846 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-2095c1e4-009b-4fed-be9c-8609e8c93a8a req-208b9c98-30ad-4d32-bafb-0218ea78f714 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:46.890442 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-2095c1e4-009b-4fed-be9c-8609e8c93a8a req-208b9c98-30ad-4d32-bafb-0218ea78f714 service nova] Creating event network-changed:7717f928-407f-44bf-be21-24013ca200b5 for instance e59f3554-3121-47a3-8819-0763cdbc8c31 on hv-cinder-83124 Sep 08 19:55:46.900052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-2095c1e4-009b-4fed-be9c-8609e8c93a8a req-208b9c98-30ad-4d32-bafb-0218ea78f714 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058476 Sep 08 19:55:46.900678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 115/234] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:47.476454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-9e76a3ca-81b1-4d44-833f-dccd45019634 req-976c0afd-1d79-47ea-85db-cc831b8061f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d470ae15-2b48-42c9-a170-e44ff12fbdc6", "tag": "925fa7d3-cd56-4e4e-bfbe-82f2d2c3286a"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:47.487778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9e76a3ca-81b1-4d44-833f-dccd45019634 req-976c0afd-1d79-47ea-85db-cc831b8061f4 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:47.488258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9e76a3ca-81b1-4d44-833f-dccd45019634 req-976c0afd-1d79-47ea-85db-cc831b8061f4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:47.490248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9e76a3ca-81b1-4d44-833f-dccd45019634 req-976c0afd-1d79-47ea-85db-cc831b8061f4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:47.501570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-9e76a3ca-81b1-4d44-833f-dccd45019634 req-976c0afd-1d79-47ea-85db-cc831b8061f4 service nova] Creating event network-changed:925fa7d3-cd56-4e4e-bfbe-82f2d2c3286a for instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 on hv-cinder-83124 Sep 08 19:55:47.507939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-9e76a3ca-81b1-4d44-833f-dccd45019634 req-976c0afd-1d79-47ea-85db-cc831b8061f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035428 Sep 08 19:55:47.509567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 120/235] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:47.663072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:47.664361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:47.683141 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:47.683404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:47.684171 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:47.685430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:47.686233 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:47.703559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:47.741465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:47.742426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:47.759520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:47.763484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:47.765803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:47.766633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:47.767114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:47.770247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:48.194082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:48.206286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d453f4ca-a515-41db-8199-d14ec799a36e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.472690 Sep 08 19:55:48.224341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 121/236] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:47 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:48.251210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:48.265567 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-55877491-cfdb-4e73-ab85-1b59ae301ab4 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1497 microversion: 2.1 time: 0.607650 Sep 08 19:55:48.266346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 116/237] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:47 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1497 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:49.074693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:49.075452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:49.085623 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:49.086463 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:49.087247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:49.088867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:49.089484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:49.090625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:49.136876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 19:55:49.234534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:49.235552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:49.240028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0033f899-64f7-40a7-9cdd-2b1775d77f1d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 204 len: 0 microversion: 2.1 time: 0.169814 Sep 08 19:55:49.241427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 122/238] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 19:55:49 2022] DELETE /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 19:55:49.246273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:49.246788 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:49.247823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:49.248904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:49.249362 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:49.249988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:49.259103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:49.260170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:49.267143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:49.267979 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:49.268631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:49.269676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:49.270280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:49.271003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:49.491538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:49.505909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bb8f4d36-8bb0-42ec-b786-5d370333a1bf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.276228 Sep 08 19:55:49.509166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 117/239] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:49 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:55:49.522561 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:49.533706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bc7504f4-6be0-4b7d-b1fc-76e1c222b201 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.285048 Sep 08 19:55:49.535638 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 123/240] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:49 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:50.530630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:50.531348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:50.538235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:50.538963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:50.539480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:50.540234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:50.540830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:50.541313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:50.558418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:50.559197 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:50.565634 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:50.566311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:50.566950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:50.568087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:50.568697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:50.569125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:50.702325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:50.714089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:50.716070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-40c9d929-3e9b-47b3-a6f0-5d19d61e2b49 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.189124 Sep 08 19:55:50.734552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 118/241] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:50 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:50.737799 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-eff5c95a-828f-4ef8-a13c-66a73aff8936 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.183893 Sep 08 19:55:50.738609 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 124/242] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:50 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:51.744135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:51.745907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:51.750078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:51.759186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:51.759786 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:51.760222 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:51.760922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:51.761348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:51.761931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:51.762967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:51.763769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:51.767927 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:51.771149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:51.771701 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:51.772166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:51.772869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:51.773326 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:51.773746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:51.891223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:51.898869 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0f08db88-1b45-46bb-a60d-34ceb56c1900 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.160165 Sep 08 19:55:51.899444 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 119/243] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:51 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:51.903961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:51.911697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-de4869c0-036e-44a5-8685-2fba05b1c34b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.153533 Sep 08 19:55:51.912339 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 125/244] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:51 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:52.925596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:52.926660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:52.931817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=8 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:52.935281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:52.936022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:52.938025 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:52.938364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:52.938682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=8 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:52.938898 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:52.939375 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:52.940143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:52.940719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:52.941037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:52.944671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:52.945154 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:52.945584 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:52.946276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:52.946778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:52.947188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:53.072785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:53.077627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:53.080579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-987be1ad-9a92-46d6-800e-f4ac03ce1e39 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.161525 Sep 08 19:55:53.081146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 120/245] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:52 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:53.087077 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4d43ae98-74a6-4088-84a7-65ac839071d0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.155950 Sep 08 19:55:53.087689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 126/246] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:52 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:54.107735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:54.108736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:54.112396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:54.113784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:54.114956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:54.120956 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:54.121761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:54.122468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:54.123699 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:54.124444 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:54.125179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:54.126446 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:54.127323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:54.128044 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:54.129205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:54.130111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:54.130913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:54.259777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:54.261348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:54.268105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0ffe4fe1-b65d-4b6f-9033-58fad9396442 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.166968 Sep 08 19:55:54.268687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 121/247] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:54 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:54.277453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-18b2940d-263d-41e4-9ecd-28079e0633bb tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.161817 Sep 08 19:55:54.277453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 127/248] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:54 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:55.294524 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:55.295599 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:55.296766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:55.298109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:55.298501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:55:55.308591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:55.308872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:55.309092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:55.309419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:55.309625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:55.309919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:55.310389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:55.310757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:55.310907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:55.311191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:55.311399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:55.311616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:55.447061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:55.456419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c02c9577-bac8-4965-a8f4-2ca29051e05d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.168186 Sep 08 19:55:55.457308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 128/249] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:55 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:55.471438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:55.480177 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f7e075d2-a020-4fd9-9d76-f065fcd71735 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.191193 Sep 08 19:55:55.495189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 122/250] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:55 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:56.481571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:56.482184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:56.488320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:56.488817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:56.489244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:56.489975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:56.490424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:56.490881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:56.506191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:56.507374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:56.515580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:56.515580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:56.515580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:56.516157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:56.516797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:56.517200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:56.672598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:56.682016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-52ca714a-f3c1-4ce5-9d4e-90c272fd3f7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.204150 Sep 08 19:55:56.682831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 129/251] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:56 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:56.803533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:56.812143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-933e0f87-a334-47aa-a9b5-dc36efbb99a2 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.312077 Sep 08 19:55:56.812724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 123/252] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:56 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:55:57.713088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:57.715085 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:57.722301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:57.722982 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:57.723564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:57.724416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:57.725009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:57.725580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:57.834528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:57.835416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:57.845474 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:57.846978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:57.851410 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:57.852157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:57.852616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:57.853041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:57.943231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:57.956161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c41cd6cb-5443-41c7-8826-8974ae32254a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.254683 Sep 08 19:55:57.956833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 130/253] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:57 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:57.961167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-f24e6e21-a3db-4675-b5b9-1aff83acc1ad req-d7dc69c9-917d-44e1-9cb0-3c89ad1929ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59f3554-3121-47a3-8819-0763cdbc8c31", "name": "network-vif-plugged", "status": "completed", "tag": "7717f928-407f-44bf-be21-24013ca200b5"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:55:57.991542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-f24e6e21-a3db-4675-b5b9-1aff83acc1ad req-d7dc69c9-917d-44e1-9cb0-3c89ad1929ca service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:57.992093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-f24e6e21-a3db-4675-b5b9-1aff83acc1ad req-d7dc69c9-917d-44e1-9cb0-3c89ad1929ca service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:57.993092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-f24e6e21-a3db-4675-b5b9-1aff83acc1ad req-d7dc69c9-917d-44e1-9cb0-3c89ad1929ca service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:58.006780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-f24e6e21-a3db-4675-b5b9-1aff83acc1ad req-d7dc69c9-917d-44e1-9cb0-3c89ad1929ca service nova] Creating event network-vif-plugged:7717f928-407f-44bf-be21-24013ca200b5 for instance e59f3554-3121-47a3-8819-0763cdbc8c31 on hv-cinder-83124 Sep 08 19:55:58.014137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-f24e6e21-a3db-4675-b5b9-1aff83acc1ad req-d7dc69c9-917d-44e1-9cb0-3c89ad1929ca service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055185 Sep 08 19:55:58.017163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 131/254] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:55:58.068100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:58.079806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0c29dad2-472e-4f2b-b4f7-ddb9fa1703b6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.249246 Sep 08 19:55:58.081060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 124/255] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:57 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:58.982064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:58.982918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:58.999526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:59.000057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:59.000951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:59.002305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:59.002995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:59.003447 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:59.104733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:55:59.105338 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:55:59.113627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:59.114175 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:59.114787 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:59.115854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:55:59.116296 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:55:59.116885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:55:59.202632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:59.213772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-558bd5f4-2db5-47c6-8e13-bd1db0c27116 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.236796 Sep 08 19:55:59.214347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 132/256] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:58 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:55:59.293032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:55:59.301657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fb840de4-db4e-4ac1-8d1b-fb4b43ece682 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.201121 Sep 08 19:55:59.302427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 125/257] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:55:59 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:00.236849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:00.237615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:00.245692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:00.246526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:00.247873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:00.248813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:00.249478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:00.250130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:00.328567 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:00.329274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:00.338325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:00.339085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:00.339619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:00.341794 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:00.342285 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:00.343071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:00.413053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:00.422375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-13d82871-dce7-43a6-a0a6-706696c8a7c7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.189720 Sep 08 19:56:00.423255 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 133/258] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:00 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:00.519461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:00.528803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b4cde35d-08f9-4c1a-91ef-40f8dbd9ac6f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1503 microversion: 2.1 time: 0.206763 Sep 08 19:56:00.529557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 126/259] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:00 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:01.341246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-ce3028dd-4167-47b5-bde0-09783c1bba7f req-cd616e66-1f96-4eb5-bb52-24088eb414f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0199af-610e-4426-a999-3a272d1bb15e", "name": "network-vif-deleted", "tag": "06a65ca2-557f-4f54-baef-678f902c2d9a"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:01.353546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-ce3028dd-4167-47b5-bde0-09783c1bba7f req-cd616e66-1f96-4eb5-bb52-24088eb414f1 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:01.355239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-ce3028dd-4167-47b5-bde0-09783c1bba7f req-cd616e66-1f96-4eb5-bb52-24088eb414f1 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:01.355239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-ce3028dd-4167-47b5-bde0-09783c1bba7f req-cd616e66-1f96-4eb5-bb52-24088eb414f1 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:01.367812 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-ce3028dd-4167-47b5-bde0-09783c1bba7f req-cd616e66-1f96-4eb5-bb52-24088eb414f1 service nova] Creating event network-vif-deleted:06a65ca2-557f-4f54-baef-678f902c2d9a for instance 9e0199af-610e-4426-a999-3a272d1bb15e on hv-cinder-83124 Sep 08 19:56:01.373723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-ce3028dd-4167-47b5-bde0-09783c1bba7f req-cd616e66-1f96-4eb5-bb52-24088eb414f1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039649 Sep 08 19:56:01.379121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 134/260] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:56:01.445666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:01.446458 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:01.454497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:01.455081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:01.455745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:01.456668 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:01.457378 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:01.457880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:01.561685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:01.562751 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:01.573914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:01.574666 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:01.575506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:01.576831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:01.577846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:01.578425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:01.618824 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:01.623659 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:01.624315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:01.624892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:01.625880 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lazy-loading 'fault' on Instance uuid 9e0199af-610e-4426-a999-3a272d1bb15e {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 19:56:01.630762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0a1dda14-a20d-4f96-9d9e-e2a3b058759e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.189286 Sep 08 19:56:01.631485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 127/261] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:01 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:01.680828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:01.689054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-dabe435a-47ca-43bb-b7b3-db93d2d05126 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1303 microversion: 2.1 time: 0.140791 Sep 08 19:56:01.703418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 135/262] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:01 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:02.654171 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:02.654963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:02.671786 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:02.672281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:02.672706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:02.673400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:02.673840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:02.674257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:02.716212 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:02.717377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:02.723953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:02.724627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:02.725202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:02.726088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:02.726746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:02.727335 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:02.732289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:02.771657 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:02.772551 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:02.773134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:02.773747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lazy-loading 'fault' on Instance uuid 9e0199af-610e-4426-a999-3a272d1bb15e {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 19:56:02.828745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:02.836754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9a9e760f-c746-478d-a256-dab61195b08b tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 200 len: 1303 microversion: 2.1 time: 0.124705 Sep 08 19:56:02.837582 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 136/263] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:02 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:02.863642 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:02.871432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ca9bb7fa-4c9b-40fd-8ae8-26a55e312413 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.221780 Sep 08 19:56:02.872245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 128/264] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:02 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:03.860557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:03.861871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 9e0199af-610e-4426-a999-3a272d1bb15e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:03.874153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:03.877965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:03.878606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:03.879470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:03.880005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:03.880491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:03.894113 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:03.894781 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:03.900878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] HTTP exception thrown: Instance 9e0199af-610e-4426-a999-3a272d1bb15e could not be found. Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Request method failure captured: Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e HTTP/1.1 Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkinGFYl82cnCLsvoZTL06ZTbg9OgwotGhyrPO5hTL73fXVVuPSuP79zEk6LCx8Oph40fOdeTZ8lIgGMDKO5KBUaBqRbzL0jL9AumU6zAt_Kq3up2VjOGxFFI1r0zgPIi7ahq2E_FYN61nkiubg0EPTPcinld0Upn9XRKC1VJqKSwSE Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 6389fd3572944faa978a04858d885678 Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesActionsTest-116514626 Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 19:56:03.903239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6389fd3572944faa978a04858d885678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6389fd3572944faa978a04858d885678", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6389fd3572944faa978a04858d885678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6389fd3572944faa978a04858d885678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesActionsTest-116514626 Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 6389fd3572944faa978a04858d885678 Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesActionsTest-116514626 Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesActionsTest-116514626-project Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 4e868e46796645fd85ee3f295d85c5f1 Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesActionsTest-116514626-project Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 9e0199af-610e-4426-a999-3a272d1bb15e could not be found. Sep 08 19:56:03.904768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '9e0199af-610e-4426-a999-3a272d1bb15e'} Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e0199af-610e-4426-a999-3a272d1bb15e could not be found. Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:56:03.905587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e0199af-610e-4426-a999-3a272d1bb15e could not be found. Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e0199af-610e-4426-a999-3a272d1bb15e could not be found. Sep 08 19:56:03.906992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 19:56:03.908224 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:03.908313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Returning 404 to user: Instance 9e0199af-610e-4426-a999-3a272d1bb15e could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:56:03.908395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:03.908395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:03.908395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:03.908395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:03.908926 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-016082cf-4c5b-473b-b0f2-42bb00f973c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e" status: 404 len: 111 microversion: 2.1 time: 0.049801 Sep 08 19:56:03.909059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:03.909359 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 137/265] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:03 2022] GET /compute/v2.1/servers/9e0199af-610e-4426-a999-3a272d1bb15e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:56:03.991231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-9604a10a-5835-4019-9fe9-330198147579 req-11ceeb89-442f-4289-b0a2-03fd999db01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d470ae15-2b48-42c9-a170-e44ff12fbdc6", "name": "network-vif-plugged", "status": "completed", "tag": "925fa7d3-cd56-4e4e-bfbe-82f2d2c3286a"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:04.019132 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9604a10a-5835-4019-9fe9-330198147579 req-11ceeb89-442f-4289-b0a2-03fd999db01d service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:04.019566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9604a10a-5835-4019-9fe9-330198147579 req-11ceeb89-442f-4289-b0a2-03fd999db01d service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:04.020000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9604a10a-5835-4019-9fe9-330198147579 req-11ceeb89-442f-4289-b0a2-03fd999db01d service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:04.044472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-9604a10a-5835-4019-9fe9-330198147579 req-11ceeb89-442f-4289-b0a2-03fd999db01d service nova] Creating event network-vif-plugged:925fa7d3-cd56-4e4e-bfbe-82f2d2c3286a for instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 on hv-cinder-83124 Sep 08 19:56:04.054938 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-9604a10a-5835-4019-9fe9-330198147579 req-11ceeb89-442f-4289-b0a2-03fd999db01d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065726 Sep 08 19:56:04.055673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 138/266] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:56:04.068780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1535339350", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "networks": [{"uuid": "33bec98c-f840-46f9-8bff-4455204420bb"}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:04.119044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:04.127408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4ea86e3a-b6cc-4052-92c6-6bdaf2715457 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.237769 Sep 08 19:56:04.129698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 129/267] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:03 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:04.147538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] validate_networks() for [('33bec98c-f840-46f9-8bff-4455204420bb', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:56:04.599459 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:56:04.600469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:56:04.601253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:56:04.601671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:56:04.602087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:56:04.611337 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:04.611890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:04.612321 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:04.613040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:04.613487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:04.613903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:04.631345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Getting quotas for project 6389fd3572944faa978a04858d885678. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:56:04.635328 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Getting quotas for user 4e868e46796645fd85ee3f295d85c5f1 and project 6389fd3572944faa978a04858d885678. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:56:04.646262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:56:04.648908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:56:04.703660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-29d69e5d-6485-4f2d-8932-fef9b320a08c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644812 Sep 08 19:56:04.704077 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 139/268] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:56:04.716016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-18d8ea4a-67fc-4cc5-8475-0d052c5a2ef0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:04.716793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-18d8ea4a-67fc-4cc5-8475-0d052c5a2ef0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:04.812876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-18d8ea4a-67fc-4cc5-8475-0d052c5a2ef0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:04.819917 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-18d8ea4a-67fc-4cc5-8475-0d052c5a2ef0 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1214 microversion: 2.1 time: 0.108625 Sep 08 19:56:04.820482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 130/269] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:04 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:05.152058 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:05.153343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:05.159991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:05.160548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:05.161099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:05.162060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:05.162593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:05.163101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:05.297598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:05.305685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-758769ea-0f6e-452d-9ff6-fbbbb9437261 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.157379 Sep 08 19:56:05.306437 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 140/270] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:05 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:05.846324 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:05.847825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:05.856431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:05.857086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:05.857800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:05.858938 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:05.859457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:05.860373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:05.932610 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:05.940738 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-48b951f5-84e6-4c79-8cc3-1be22dca4f52 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1266 microversion: 2.1 time: 0.099738 Sep 08 19:56:05.941398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 131/271] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:05 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:06.330712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:06.331344 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:06.337520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:06.338004 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:06.338461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:06.339211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:06.343378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:06.343892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:06.482284 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:06.490148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fa36b610-58d0-42c2-b856-c2de1b47a155 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.164253 Sep 08 19:56:06.490839 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 141/272] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:06 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:06.969631 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:06.970843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:06.980936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:06.981390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:06.981857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:06.982555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:06.983045 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:06.983471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:07.048530 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:07.056588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2a97e8a6-2809-4dc5-84f9-a8ac0247f5ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1266 microversion: 2.1 time: 0.093798 Sep 08 19:56:07.057147 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 132/273] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:06 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:07.517647 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:07.518572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:07.528883 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:07.529720 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:07.530428 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:07.531664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:07.532370 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:07.533063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:07.663390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:07.671648 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e4eabb82-9ab3-4483-9f18-6b9636c1a6c0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.160339 Sep 08 19:56:07.672217 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 142/274] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:07 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:08.079883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:08.080501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:08.087123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:08.087611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:08.088052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:08.088914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:08.089501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:08.090155 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:08.151364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:08.159669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d94a67da-6f8a-4fbf-84c4-33c6d050085e tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1266 microversion: 2.1 time: 0.084113 Sep 08 19:56:08.160165 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 133/275] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:08 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:08.694088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:08.694802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:08.701295 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:08.701786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:08.702222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:08.702943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:08.703401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:08.703828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:08.837055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:08.845095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3ad68af8-2bcc-4897-93e0-e65b884d075d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1322 microversion: 2.1 time: 0.154946 Sep 08 19:56:08.845659 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 143/276] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:08 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:09.181488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:09.182089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:09.188724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:09.189243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:09.189669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:09.190353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:09.190862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:09.191275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:09.252198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:09.260330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-507a3bc9-a6de-4ede-a37c-048a4a499fee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1266 microversion: 2.1 time: 0.082782 Sep 08 19:56:09.260890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 134/277] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:09 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:09.871558 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:09.872533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:09.882978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:09.883780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:09.884501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:09.885627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:09.886380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:09.887081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.019002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:10.026990 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-edd5860c-8088-4f36-90c4-e8972efbf771 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1516 microversion: 2.1 time: 0.161840 Sep 08 19:56:10.027738 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 144/278] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:09 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:10.049010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:10.051382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:10.057427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:10.057908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:10.058338 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.059121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:10.059598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:10.059995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.082482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lazy-loading 'flavor' on Instance uuid d470ae15-2b48-42c9-a170-e44ff12fbdc6 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 19:56:10.155945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:10.201896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-807c997d-d4c5-4008-92c5-9eabb9efe1cd tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6/action" status: 200 len: 32 microversion: 2.1 time: 0.156903 Sep 08 19:56:10.202498 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 135/279] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 19:56:10 2022] POST /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 19:56:10.212254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:10.212881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:10.219256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:10.219813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:10.220402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.221229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:10.221710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:10.222197 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.284109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:10.284936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:10.292207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:10.292691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:10.293275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.294007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:10.294433 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:10.294929 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:10.356763 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:10.360353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:10.364771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-89f5f5d0-1ae3-442c-a3ee-4de5b4286512 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.156382 Sep 08 19:56:10.365348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 145/280] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:10 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:10.368097 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-06f1b716-eece-4180-8b7b-297652263124 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1266 microversion: 2.1 time: 0.088288 Sep 08 19:56:10.368692 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 136/281] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:10 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:11.388527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:11.389163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:11.390843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:11.391310 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:11.395705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:11.396200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:11.396631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:11.397321 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:11.397769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:11.397953 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:11.398155 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:11.398463 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:11.398937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:11.399612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:11.400084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:11.400494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:11.527586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:11.530956 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:11.535615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5255d044-1566-4bed-8b17-9f4b237f76f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.151320 Sep 08 19:56:11.536283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 146/282] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:11 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:11.539016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-59f827b9-faca-496b-a505-65ae5d07ffba tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.152228 Sep 08 19:56:11.539563 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 137/283] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:11 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:12.561651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:12.563343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:12.563753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:12.564500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:12.571265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:12.571884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:12.572419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:12.572740 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:12.573272 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:12.573447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:12.573835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:12.574028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:12.574325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:12.574990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:12.575534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:12.576056 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:12.706214 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:12.706578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:12.714600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-11293159-3490-4834-9012-b544c67a6d88 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.155749 Sep 08 19:56:12.715056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c60fffdc-d8c5-4793-bb76-289d04a918b1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.158791 Sep 08 19:56:12.715310 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 138/284] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:12 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:12.715585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 147/285] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:12 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:13.737838 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:13.738487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:13.738912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:13.739024 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:13.745723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:13.745909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:13.746574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:13.746710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:13.746876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:13.747253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:13.747620 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:13.748072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:13.748181 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:13.748523 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:13.748637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:13.748996 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:13.883498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:13.885088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:13.891390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7391891e-2945-494d-b36f-34bd7335e0b3 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.157610 Sep 08 19:56:13.891967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 148/286] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:13 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:13.892870 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2bc3fe95-98a5-45d1-95b4-bc083fdb0910 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.159128 Sep 08 19:56:13.893407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 139/287] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:13 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:14.914429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:14.915644 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:14.917084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:14.918075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:14.922049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:14.922205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:14.923113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=6 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:14.924891 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:14.925670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:14.926197 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:14.927037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:14.927652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:14.927794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:14.928288 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:14.928493 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:14.928798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:14.929508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:14.929975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:14.930404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:15.063631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:15.074292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-08b33cd2-4a5c-40d3-88df-c18fda10f1bc tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.164419 Sep 08 19:56:15.075468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 149/288] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:14 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:15.128925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-d9601bd1-d626-44e0-a140-540306a7b000 req-b17e261a-ee8d-44ce-9076-d45c881b21e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8949b52a-4fbf-42b8-a183-b4bfc1bd78d9", "tag": "03a1f99c-7eee-4ba5-afad-f3cf9bc43575"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:15.139527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d9601bd1-d626-44e0-a140-540306a7b000 req-b17e261a-ee8d-44ce-9076-d45c881b21e3 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:15.145991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d9601bd1-d626-44e0-a140-540306a7b000 req-b17e261a-ee8d-44ce-9076-d45c881b21e3 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:15.146460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d9601bd1-d626-44e0-a140-540306a7b000 req-b17e261a-ee8d-44ce-9076-d45c881b21e3 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:15.153159 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:15.165958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-d9601bd1-d626-44e0-a140-540306a7b000 req-b17e261a-ee8d-44ce-9076-d45c881b21e3 service nova] Creating event network-changed:03a1f99c-7eee-4ba5-afad-f3cf9bc43575 for instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 on hv-cinder-83124 Sep 08 19:56:15.169035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ec0144f2-1a3e-41cf-b411-c5a4df78dff5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.257072 Sep 08 19:56:15.169632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 140/289] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:14 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:15.187031 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-d9601bd1-d626-44e0-a140-540306a7b000 req-b17e261a-ee8d-44ce-9076-d45c881b21e3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062212 Sep 08 19:56:15.187912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 150/290] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:56:16.101250 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:16.101886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:16.112480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:16.112965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:16.113425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:16.114130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:16.114604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:16.115049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:16.192228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:16.192962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:16.199520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:16.200204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:16.200418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:16.201305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:16.201936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:16.201936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:16.265287 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:16.274052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c69be1be-592c-4d39-8d2b-b319dd40988d tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.179293 Sep 08 19:56:16.287310 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 141/291] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:16 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:16.345568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:16.356830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d91d9608-c570-4af7-95fc-935518113641 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.168880 Sep 08 19:56:16.357447 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 151/292] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:16 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:17.298826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:17.299398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:17.305966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:17.306438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:17.306899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:17.307572 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:17.308019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:17.308432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:17.380469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:17.381095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:17.387590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:17.388081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:17.388508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:17.389206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:17.389746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:17.390071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:17.440649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:17.448499 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3933f770-a003-4290-b3a6-7e4c63b8ad94 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.153642 Sep 08 19:56:17.449105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 142/293] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:17 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:17.522193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:17.530556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ae5992c3-cca8-42b7-92b4-99c9eed4ad89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.154525 Sep 08 19:56:17.531161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 152/294] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:17 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:18.473871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:18.475162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:18.482816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:18.483304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:18.483740 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:18.484451 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:18.484906 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:18.485331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:18.564042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:18.564642 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:18.571249 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:18.571728 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:18.572160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:18.572862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:18.573327 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:18.573731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:18.711823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:18.716779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:18.722352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8c96a542-bf85-4501-9e6a-39c712442707 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.162210 Sep 08 19:56:18.723890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 153/295] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:18 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:18.725212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cbc805db-c5f5-4c34-9635-717e44364d40 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.256449 Sep 08 19:56:18.725784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 143/296] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:18 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:19.749601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:19.750580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:19.752080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:19.752793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:19.757394 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:19.757874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:19.758493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:19.760037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:19.760670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:19.761279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:19.763829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:19.765312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:19.766182 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:19.770802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:19.771878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:19.772393 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:19.907738 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:19.916712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d88ab689-a204-4e59-91b0-3295fdee064d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.172152 Sep 08 19:56:19.931158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 154/297] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:19 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:19.941439 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:19.949109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-05e3e2c1-8793-42a9-905f-290d4fecfdd6 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.204253 Sep 08 19:56:19.961832 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 144/298] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:19 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:20.941563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:20.942318 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:20.948591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:20.949141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:20.949809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:20.950570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:20.951153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:20.951689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:20.955961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:20.972995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:20.973724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:20.981379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:20.981820 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:20.982288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:20.983081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:20.983621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:20.984050 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:21.219940 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:21.229649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a2f72e19-35c7-4cd7-8271-74c1b60ec16f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.261541 Sep 08 19:56:21.230766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 145/299] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:20 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:21.240763 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:21.252793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2f99ba50-4a08-4d25-92ed-49253c31840e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.315875 Sep 08 19:56:21.254341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 155/300] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:20 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:22.254681 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:22.255297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:22.263977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:22.264456 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:22.264883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:22.275043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:22.275043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:22.275043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:22.279889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:22.280497 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:22.296643 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:22.298116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:22.298839 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:22.299567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:22.300031 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:22.306694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:22.485026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:22.496703 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8c0f94f4-c2b4-40be-bd9b-37fc123d85e8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.246378 Sep 08 19:56:22.501308 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 146/301] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:22 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:22.508021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-755b6569-7610-4944-a5ec-75eac3218624 req-2e7efaf7-9066-4e47-945a-c373aa3b9b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8949b52a-4fbf-42b8-a183-b4bfc1bd78d9", "name": "network-vif-plugged", "status": "completed", "tag": "03a1f99c-7eee-4ba5-afad-f3cf9bc43575"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:22.530464 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:22.534092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-755b6569-7610-4944-a5ec-75eac3218624 req-2e7efaf7-9066-4e47-945a-c373aa3b9b77 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:22.534593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-755b6569-7610-4944-a5ec-75eac3218624 req-2e7efaf7-9066-4e47-945a-c373aa3b9b77 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:22.535044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-755b6569-7610-4944-a5ec-75eac3218624 req-2e7efaf7-9066-4e47-945a-c373aa3b9b77 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:22.546127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f476f4c6-1431-40fd-9842-c01bddfcc182 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.270072 Sep 08 19:56:22.547528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 156/302] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:22 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:22.548147 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-755b6569-7610-4944-a5ec-75eac3218624 req-2e7efaf7-9066-4e47-945a-c373aa3b9b77 service nova] Creating event network-vif-plugged:03a1f99c-7eee-4ba5-afad-f3cf9bc43575 for instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 on hv-cinder-83124 Sep 08 19:56:22.553225 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-755b6569-7610-4944-a5ec-75eac3218624 req-2e7efaf7-9066-4e47-945a-c373aa3b9b77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050772 Sep 08 19:56:22.553987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 147/303] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:56:23.522167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:23.522782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:23.529519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:23.530213 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:23.530757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:23.531674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:23.532196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:23.532700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:23.573004 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:23.573793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:23.581071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:23.581549 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:23.581982 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:23.582717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:23.583172 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:23.583592 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:23.738138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:23.747904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:23.760329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1bde2be3-e0c4-48c4-894b-b4727543db8f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.192355 Sep 08 19:56:23.760934 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 148/304] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:23 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:23.779829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d601783b-5d73-48fc-9a22-d17e11f31691 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1314 microversion: 2.1 time: 0.261359 Sep 08 19:56:23.780468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 157/305] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:23 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:24.785719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:24.786397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:24.789566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=58 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:24.801189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:24.801676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:24.802104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:24.805159 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:24.805276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:24.805680 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:24.805777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:24.806107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:24.823593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:24.826099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:24.826670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:24.828165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:24.833732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:24.836133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:25.001401 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:25.009602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2f1f642f-bcac-4e5a-a95f-67dad65d970e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.227876 Sep 08 19:56:25.010176 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 149/306] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:24 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:25.100889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:25.108925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4f429d22-f645-49a3-8e3f-811a5ede8c51 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1498 microversion: 2.1 time: 0.308422 Sep 08 19:56:25.109575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 158/307] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:24 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1498 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:25.773044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:25.773542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:25.781765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:25.782556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:25.783202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:25.784337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:25.784970 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:25.785574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:25.812806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 19:56:25.890873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:25.931608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-829c6e6b-f0a2-4495-b9b7-7dda000e82c8 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 204 len: 0 microversion: 2.1 time: 0.162168 Sep 08 19:56:25.939845 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 150/308] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 19:56:25 2022] DELETE /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 19:56:25.942431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:25.943823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:25.949805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:25.951744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:25.952490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:25.953130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:25.954445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:25.956199 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:25.956732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:26.033498 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:26.034373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:26.052266 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:26.052797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:26.053283 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:26.054303 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:26.054982 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:26.055481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:26.208385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:26.216533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3d14df8e-c72c-4675-b896-1b5e8fd6854c tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1504 microversion: 2.1 time: 0.279040 Sep 08 19:56:26.217104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 159/309] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:25 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:26.349767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:26.364252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2a692cb9-f954-444c-85e2-d0a28c23d481 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.335612 Sep 08 19:56:26.380097 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 151/310] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:26 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:27.239155 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:27.240421 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:27.247003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:27.248202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:27.248834 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:27.249750 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:27.250797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:27.251416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:27.389811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:27.390429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:27.407627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:27.408149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:27.409805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:27.411788 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:27.412581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:27.413844 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:27.436250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:27.448526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-65112052-eae6-4f6d-96d8-60bfefe6b329 tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1504 microversion: 2.1 time: 0.213090 Sep 08 19:56:27.449119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 160/311] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:27 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:28.022682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:28.031026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6491c969-e0cb-4db4-831e-6312f638707a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.645464 Sep 08 19:56:28.033347 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 152/312] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:27 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:28.476550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:28.477168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:28.486060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:28.486835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:28.487461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:28.488538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:28.489001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:28.489374 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:28.613879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e868e46796645fd85ee3f295d85c5f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6389fd3572944faa978a04858d885678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:28.669704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d5964866-766e-4cd1-a48b-48885457ff5f tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 200 len: 1462 microversion: 2.1 time: 0.198061 Sep 08 19:56:28.671605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 161/313] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:28 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 1462 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:28.689666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-db5d786c-e93f-482c-b4ec-5f05966d1e65 req-1990e507-e45c-42ae-b763-5ce858715570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8949b52a-4fbf-42b8-a183-b4bfc1bd78d9", "name": "network-vif-deleted", "tag": "03a1f99c-7eee-4ba5-afad-f3cf9bc43575"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:28.719158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-db5d786c-e93f-482c-b4ec-5f05966d1e65 req-1990e507-e45c-42ae-b763-5ce858715570 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:28.719923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-db5d786c-e93f-482c-b4ec-5f05966d1e65 req-1990e507-e45c-42ae-b763-5ce858715570 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:28.722786 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-db5d786c-e93f-482c-b4ec-5f05966d1e65 req-1990e507-e45c-42ae-b763-5ce858715570 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:28.741181 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-db5d786c-e93f-482c-b4ec-5f05966d1e65 req-1990e507-e45c-42ae-b763-5ce858715570 service nova] Creating event network-vif-deleted:03a1f99c-7eee-4ba5-afad-f3cf9bc43575 for instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 on hv-cinder-83124 Sep 08 19:56:28.747209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-db5d786c-e93f-482c-b4ec-5f05966d1e65 req-1990e507-e45c-42ae-b763-5ce858715570 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069135 Sep 08 19:56:28.748630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 153/314] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:56:29.055741 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:29.056655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:29.077780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:29.082807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:29.083501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:29.084440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:29.085159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:29.085744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:29.283102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:29.294903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b635a61e-179b-4bdc-bdf4-1608a502d4d0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.242726 Sep 08 19:56:29.311535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 162/315] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:29 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:29.699703 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:29.701197 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] [instance: 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:29.708509 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:29.709170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:29.709753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:29.710665 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:29.711286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:29.711857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:29.730561 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] HTTP exception thrown: Instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 could not be found. Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Request method failure captured: Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 HTTP/1.1 Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkinGFYl82cnCLsvoZTL06ZTbg9OgwotGhyrPO5hTL73fXVVuPSuP79zEk6LCx8Oph40fOdeTZ8lIgGMDKO5KBUaBqRbzL0jL9AumU6zAt_Kq3up2VjOGxFFI1r0zgPIi7ahq2E_FYN61nkiubg0EPTPcinld0Upn9XRKC1VJqKSwSE Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 6389fd3572944faa978a04858d885678 Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-VolumesActionsTest-116514626 Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:56:29.732606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6389fd3572944faa978a04858d885678"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6389fd3572944faa978a04858d885678", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6389fd3572944faa978a04858d885678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6389fd3572944faa978a04858d885678"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-VolumesActionsTest-116514626 Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 6389fd3572944faa978a04858d885678 Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-VolumesActionsTest-116514626 Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-VolumesActionsTest-116514626-project Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 4e868e46796645fd85ee3f295d85c5f1 Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-VolumesActionsTest-116514626-project Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 could not be found. Sep 08 19:56:29.734143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '8949b52a-4fbf-42b8-a183-b4bfc1bd78d9'} Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 could not be found. Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:56:29.735027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 could not be found. Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 could not be found. Sep 08 19:56:29.736195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:56:29.738583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] Returning 404 to user: Instance 8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:56:29.740452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-67187456-a3ec-4cbb-b19b-ec0efa97f8ee tempest-VolumesActionsTest-116514626 tempest-VolumesActionsTest-116514626-project] 10.222.0.44 "GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9" status: 404 len: 111 microversion: 2.1 time: 0.044502 Sep 08 19:56:29.741208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 154/316] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:29 2022] GET /compute/v2.1/servers/8949b52a-4fbf-42b8-a183-b4bfc1bd78d9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:56:30.319850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:30.320472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:30.340520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:30.343093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:30.346535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:30.354180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:30.356093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:30.359259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:30.598144 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:30.613546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d086ede5-ae86-4771-8aea-27972009cdff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.297696 Sep 08 19:56:30.618210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 163/317] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:30 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:31.643710 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:31.644374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:31.657527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:31.658210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:31.658834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:31.659731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:31.660344 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:31.660926 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:31.899115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:31.911867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6bb455e5-9d08-4e47-a87a-4a029d6445cf tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.271991 Sep 08 19:56:31.912793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 155/318] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:31 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:32.939924 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:32.940520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:32.950438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:32.951331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:32.957227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:32.958057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:32.958739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:32.959177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:33.235288 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:33.248529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ebc5da5e-0418-4e8a-8a34-4ce71418021d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.312042 Sep 08 19:56:33.249703 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 164/319] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:32 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:34.275590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:34.276928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:34.289706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:34.291640 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:34.292209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:34.294773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:34.295373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:34.297193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:34.542909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:34.556574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7474d928-6a15-41ad-a72c-974fdf846773 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.284655 Sep 08 19:56:34.558413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 156/320] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:34 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:34.989588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8320223a-fcd2-4556-b2c5-7f2ba1161c07 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Action: 'create', calling method: .version_select at 0x7fef84fde280>, body: {"keypair": {"name": "tempest-TestShelveInstance-2141314357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOuUEq6yKcdgMSLidHT8azw4d6rERBxOjCSGHeGTzjfksooq6hEwpzDdygcOikQoWcE0XzQZyXUJrsyjLoF34VOosLGruo1kEus453FZJs25OT/ompsMjlZurwHal17Bw=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:35.016646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-8320223a-fcd2-4556-b2c5-7f2ba1161c07 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Getting quotas for project ffecc3e1b5c04268a904802a752ef7f5. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:56:35.020873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-8320223a-fcd2-4556-b2c5-7f2ba1161c07 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Getting quotas for user fc6e67be2d33406fb8fb23674f9aa679 and project ffecc3e1b5c04268a904802a752ef7f5. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:56:35.052223 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8320223a-fcd2-4556-b2c5-7f2ba1161c07 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.441359 Sep 08 19:56:35.059113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 165/321] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 19:56:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:56:35.580416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:35.581220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:35.589940 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:35.590140 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:35.590600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:35.591488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:35.591978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:35.592400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:35.812251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:35.822308 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-68bb2cc4-aa8f-484e-a79f-df21a142240b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.246632 Sep 08 19:56:35.836150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 157/322] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:35 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:36.847614 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:36.848360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:36.856845 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:36.857419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:36.857852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:36.858550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:36.860545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:36.860973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:37.063871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:37.072997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a6566f34-8728-4601-82ed-59c29c7159ce tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.229089 Sep 08 19:56:37.073865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 166/323] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:36 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:38.099254 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:38.099868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:38.106723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:38.107289 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:38.107742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:38.108464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:38.108947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:38.109564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:38.281070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:38.292131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2c1165c8-a768-4d0a-8a13-75cd85fc8695 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.196605 Sep 08 19:56:38.307437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 158/324] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:38 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:39.323457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:39.324117 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:39.332638 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:39.333820 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:39.334617 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:39.337183 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:39.338136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:39.339277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:39.536930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:39.546378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-08b54e0b-1424-49a7-a0fc-f33fc22cd5e2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1522 microversion: 2.1 time: 0.235109 Sep 08 19:56:39.548831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 167/325] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:39 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:40.579187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:40.579930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:40.587607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:40.588127 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:40.588554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:40.589258 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:40.589698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:40.590152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:40.808721 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:40.819596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e7bf17c4-9bc4-4916-9f3e-f57f5ee3c63f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1502 microversion: 2.1 time: 0.244848 Sep 08 19:56:40.820431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 159/326] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:40 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1502 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:40.845318 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:40.846570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:40.853793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:40.855253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:40.855930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:40.856913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:40.857660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:40.858318 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:41.060613 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:41.072851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-789ef3a1-1a5c-4edf-94ab-afe3a0bea928 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1515 microversion: 2.1 time: 0.232165 Sep 08 19:56:41.073663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 168/327] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:40 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:43.622814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:56:43.626349 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:43.639773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:43.650138 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:43.651668 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:43.652689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:43.653425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:43.653842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:43.688255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lazy-loading 'flavor' on Instance uuid e59f3554-3121-47a3-8819-0763cdbc8c31 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 19:56:43.777158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-392224e5-ae84-4f64-bb04-dafdcbacd2a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/action" status: 200 len: 32 microversion: 2.1 time: 0.158651 Sep 08 19:56:43.783478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 160/328] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 19:56:43 2022] POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 19:56:43.805138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:43.806620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:43.813735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:43.814330 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:43.814791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:43.815589 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:43.816019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:43.816529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:44.010510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:44.018535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-27a5d8fb-d5c5-423e-83e5-f57e89252610 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.233530 Sep 08 19:56:44.019142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 169/329] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:43 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:45.043611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:45.046187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:45.053538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:45.054915 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:45.055533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:45.057455 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:45.058265 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:45.058979 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:45.240456 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:45.266777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4180b76e-d99a-4813-b865-a32e411f536d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.227203 Sep 08 19:56:45.270332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 161/330] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:45 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:46.293914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:46.296021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:46.308717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:46.310628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:46.311449 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:46.312019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:46.312900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:46.313571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:46.314270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:46.508116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:46.517630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a7fb9a89-8ac1-4969-aee1-4a589622d955 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.228076 Sep 08 19:56:46.518516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 170/331] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:46 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:47.558352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:47.559899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:47.572521 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:47.574320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:47.575632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:47.576991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:47.578413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:47.579473 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:47.960337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:47.970497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-833c9490-d700-41de-a0ec-e623bf115f56 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.431177 Sep 08 19:56:47.987465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 162/332] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:47 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:49.001944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:49.006336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:49.016934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:49.017783 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:49.019319 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:49.020315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:49.020997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:49.021673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:49.279311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:49.290303 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d2dbd04c-fc71-41c4-bf4b-221d40ad0670 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.298098 Sep 08 19:56:49.310881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 171/333] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:48 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:50.317527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:50.318922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:50.328957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:50.333015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:50.333759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:50.336364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:50.337104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:50.339047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:51.069194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:51.083126 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8b76b32d-5ecc-4dcf-b21e-d73dc36cbc22 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.769512 Sep 08 19:56:51.100072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 163/334] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:50 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:52.116732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:52.118848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:52.134937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:52.135842 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:52.136953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:52.137882 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:52.138837 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:52.139714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:52.152769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=95 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:52.383980 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:52.399357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2cdf6960-4bdd-484c-b65f-afeb01e76ced tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.296504 Sep 08 19:56:52.399944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 172/335] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:52 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:53.425211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:53.425816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:53.452485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:53.457183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:53.457695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:53.466808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:53.469455 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:53.472580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:53.771032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:53.786998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-99224dac-6a3a-4a94-8da6-4b444cd63c89 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.366851 Sep 08 19:56:53.789669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 164/336] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:53 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:54.821774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:54.822438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:54.832160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:54.832687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:54.834203 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:54.835381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:54.835824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:54.836457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:55.319583 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:55.335230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5533a8db-69da-4420-be82-a0de7edfa208 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.522851 Sep 08 19:56:55.337791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 173/337] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:54 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:56:56.364895 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:56.365553 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:56.374962 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:56.387380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:56.392883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:56.393341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:56.395443 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:56.400286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:56.400850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:56.414587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:56.698997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:56.718937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c13d4a59-0f6a-4c96-b53e-313f615cd2f4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.352624 Sep 08 19:56:56.718937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 165/338] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:56 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:57.757616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:57.764506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:57.767061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:56:57.781848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:57.782355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:57.794159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:57.794159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:57.794159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:57.794900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:58.121504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:58.134874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5fdfe502-eff0-417d-80d4-f5aa008d6d1f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.392485 Sep 08 19:56:58.149066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 174/339] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:57 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:56:59.170396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:56:59.171095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:56:59.187875 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:59.188385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:59.189168 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:59.189890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:56:59.190341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:56:59.190808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:56:59.448358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:56:59.458200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d05b25ce-8d6d-492a-8ab5-ba96fb46756a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.302468 Sep 08 19:56:59.471446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 166/340] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:56:59 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:00.487816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:00.492700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:00.503302 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:00.503865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:00.504301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:00.505010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:00.511350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:00.518557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:00.842178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:00.853563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-72d77332-3436-40e8-af8c-c72faeb53b12 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.374310 Sep 08 19:57:00.860266 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 175/341] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:00 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:01.883097 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:01.883954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:01.901476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:01.902615 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:01.904603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:01.907706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:01.909008 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:01.917555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:02.160274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:02.169650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-319a80fd-9829-4b82-bb4d-95a32fbacd00 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.290307 Sep 08 19:57:02.187933 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 167/342] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:01 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:03.197885 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:03.199509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:03.206113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:03.206862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:03.207450 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:03.208301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:03.208905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:03.209471 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:03.400107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:03.415351 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f4785ed3-3974-48cd-a237-079ec8bff6e8 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.221235 Sep 08 19:57:03.427751 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 176/343] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:03 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:04.440489 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:04.441941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:04.453773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:04.465389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:04.467918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:04.470218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:04.472518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:04.474228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:04.657236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:04.667192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5447b2bb-7103-40b0-8997-d5166b659e41 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.231076 Sep 08 19:57:04.668167 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 168/344] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:04 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:05.690682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:05.691360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:05.702051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:05.702897 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:05.704140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:05.715041 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:05.715563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:05.716074 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:05.946327 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:05.958098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-38b32c4e-b976-4182-9bfa-150684cfedd5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.271518 Sep 08 19:57:05.958697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 177/345] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:05 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:06.588393 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2126253779", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2141314357", "security_groups": [{"name": "tempest-secgroup-smoke-1581553989"}], "networks": [{"uuid": "56f6f891-b7ba-48d4-92e0-e533af536150"}], "block_device_mapping_v2": [{"uuid": "b3db7af4-a2cd-44ff-a038-d008d4f5a7d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:06.757351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] validate_networks() for [('56f6f891-b7ba-48d4-92e0-e533af536150', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:57:06.981241 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:06.982705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:06.989168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:06.989995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:06.990620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:06.991556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:06.992248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:06.992854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:07.272486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:57:07.273122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:57:07.273737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:57:07.274299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:57:07.274892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:57:07.278469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:07.286941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f9973378-1b3e-4ee4-903c-73fa03994266 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.309523 Sep 08 19:57:07.288211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:07.288871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:07.289803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:07.290228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 178/346] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:06 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:07.296136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:07.297275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:07.297860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:07.324288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Getting quotas for project ffecc3e1b5c04268a904802a752ef7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:07.329424 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Getting quotas for user fc6e67be2d33406fb8fb23674f9aa679 and project ffecc3e1b5c04268a904802a752ef7f5. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:07.403487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:57:07.406750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3db7af4-a2cd-44ff-a038-d008d4f5a7d8',volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:57:07.617888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-35de96a3-0bbe-4916-8746-5f662f69b27d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.034970 Sep 08 19:57:07.626076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 169/347] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:57:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:57:07.630815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5c73af63-a591-430e-88de-48b558fbb08a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:07.631733 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5c73af63-a591-430e-88de-48b558fbb08a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:07.688479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5c73af63-a591-430e-88de-48b558fbb08a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:07.697915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5c73af63-a591-430e-88de-48b558fbb08a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1089 microversion: 2.1 time: 0.070932 Sep 08 19:57:07.698495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 179/348] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:07 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:08.315836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:08.316564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:08.351314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:08.352298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:08.352298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:08.352943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:08.353396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:08.353816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:08.565858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:08.599210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6e9f2a5c-0a2e-457f-967c-960b0413633a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.290301 Sep 08 19:57:08.600398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 170/349] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:08 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:08.727035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:08.727798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:08.734240 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:08.736713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:08.738154 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:08.743709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:08.744490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:08.745119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:08.819189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:08.828934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-232155ba-053b-4bf5-885c-9216c74b45fe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1131 microversion: 2.1 time: 0.112126 Sep 08 19:57:08.844543 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 180/350] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:08 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1131 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:09.625083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:09.626444 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:09.633402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:09.634255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:09.634962 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:09.636189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:09.636938 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:09.637631 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:09.851140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:09.852536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:09.860446 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:09.862602 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:09.863219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:09.864697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:09.872925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:09.873569 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:09.940491 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:09.951122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5265e799-7cb4-405e-8ef4-3f346c871c59 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1501 microversion: 2.1 time: 0.332316 Sep 08 19:57:09.953347 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 171/351] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:09 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:09.963805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:09.977703 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a172c611-8f77-4211-9376-def875707e9e"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:09.981993 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:09.982828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f49211e7-e36d-48ce-8a9b-69b0018c8623 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1205 microversion: 2.1 time: 0.135337 Sep 08 19:57:09.985969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 181/352] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:09 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1205 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:09.992792 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:09.993546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:09.994144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:09.995141 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:09.995732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:09.996974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:10.029059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] HTTP exception thrown: Cannot 'attach_volume' instance e59f3554-3121-47a3-8819-0763cdbc8c31 while it is in vm_state rescued Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Request method failure captured: Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/os-volume_attachments HTTP/1.1 Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 74 Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGki8d-OB0eDZ6Vkt6UGghZDoe2rkUKNqUW6RrQAoj2pXCX_uM4l3YTYgJNBXCXNPa9PrTw2ITxH4qPaSK3uqdgFCHkVqTNenktwQlSFFXyhCqUbJ-xQ214ld5YWe70ZxxMqS30CGwHbQL0h7zEh7W6EeSS_lEVvvtoj__iGRWZgYx5c Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:57:10.031293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_933256f83bff41ff986dd79bd06a6b74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 628b75f16eb14ce1b7deed61ade28b9c Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {"volumeAttachment": {"volumeId": "a172c611-8f77-4211-9376-def875707e9e"}} Sep 08 19:57:10.032695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Cannot 'attach_volume' instance e59f3554-3121-47a3-8819-0763cdbc8c31 while it is in vm_state rescued Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'server_id': 'e59f3554-3121-47a3-8819-0763cdbc8c31', 'body': {'volumeAttachment': {'volumeId': 'a172c611-8f77-4211-9376-def875707e9e'}}} Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:57:10.033589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e59f3554-3121-47a3-8819-0763cdbc8c31 while it is in vm_state rescued Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:57:10.034996 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:57:10.036170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:57:10.036170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:57:10.036170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e59f3554-3121-47a3-8819-0763cdbc8c31 while it is in vm_state rescued Sep 08 19:57:10.036170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:10.037567 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Returning 409 to user: Cannot 'attach_volume' instance e59f3554-3121-47a3-8819-0763cdbc8c31 while it is in vm_state rescued {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:57:10.038921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0a532e18-65a4-4070-aa58-564055cd6569 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066041 Sep 08 19:57:10.039682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 172/353] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:57:09 2022] POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 19:57:10.049256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:10.049965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:10.056410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:10.057470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:10.058164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:10.059251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:10.059896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:10.060515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:10.208138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ed619894-85ce-4d18-a76e-ab281cddb78d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/action" status: 202 len: 0 microversion: 2.1 time: 0.160480 Sep 08 19:57:10.212450 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 182/354] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 19:57:10 2022] POST /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 19:57:10.217928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:10.218745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:10.231743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:10.235518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:10.235991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:10.240036 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:10.241941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:10.242669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:10.606474 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:10.622931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fc4cde7b-0ad2-4606-98ab-79373f9439ba tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1509 microversion: 2.1 time: 0.407423 Sep 08 19:57:10.623863 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 173/355] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:10 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1509 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:11.010965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:11.012448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:11.027565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:11.029612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:11.030403 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:11.031592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:11.032360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:11.036137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:11.299172 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:11.312831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-baa64065-51f7-46e3-a9c9-844a0577792f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.306954 Sep 08 19:57:11.314084 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 183/356] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:11 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:11.493201 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2101239045", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:11.574268 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] validate_networks() for None {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:57:11.653653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:11.654782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:11.669438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:11.670316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:11.671052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:11.672456 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:11.673167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:11.674077 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:11.855243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:11.868527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-baf6e18f-81c2-4a01-825e-565e07bae79d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1509 microversion: 2.1 time: 0.221366 Sep 08 19:57:11.871709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 184/357] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:11 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:12.264452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:57:12.265165 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:57:12.265911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:57:12.266523 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:57:12.267199 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:57:12.282911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.284126 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.285004 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.286155 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.287341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.287941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.317655 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Getting quotas for project fa36405a47124471b9ebd558705ec14f. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:12.323323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Getting quotas for user 55fcf3af65c34cd88dc79b4df8429771 and project fa36405a47124471b9ebd558705ec14f. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:12.339213 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:12.339843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:12.350415 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.351537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.352151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.352927 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:57:12.353286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.353917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.354503 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.356903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:57:12.442320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a2f836a6-a23e-4fca-b4be-a822f6b697a4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956013 Sep 08 19:57:12.443379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 174/358] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:57:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:57:12.453315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-6f3dbccf-73f4-4684-9dc2-9cd48ba8a5e0 req-a22e36c4-3f23-4f30-b086-cf6a55ba8054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:12.464926 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6f3dbccf-73f4-4684-9dc2-9cd48ba8a5e0 req-a22e36c4-3f23-4f30-b086-cf6a55ba8054 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.465583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6f3dbccf-73f4-4684-9dc2-9cd48ba8a5e0 req-a22e36c4-3f23-4f30-b086-cf6a55ba8054 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.466103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6f3dbccf-73f4-4684-9dc2-9cd48ba8a5e0 req-a22e36c4-3f23-4f30-b086-cf6a55ba8054 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.479532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-6f3dbccf-73f4-4684-9dc2-9cd48ba8a5e0 req-a22e36c4-3f23-4f30-b086-cf6a55ba8054 service nova] Creating event network-changed:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 19:57:12.538678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:12.543398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-6f3dbccf-73f4-4684-9dc2-9cd48ba8a5e0 req-a22e36c4-3f23-4f30-b086-cf6a55ba8054 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098176 Sep 08 19:57:12.548944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 175/359] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:12.552654 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0632d260-81b0-400e-bf18-4258842bc79a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.219537 Sep 08 19:57:12.558014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f7876cbc-4b3f-406d-855f-f7ba1795a84e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:12.564012 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f7876cbc-4b3f-406d-855f-f7ba1795a84e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:12.564628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 185/360] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:12 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:12.637779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f7876cbc-4b3f-406d-855f-f7ba1795a84e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:12.647528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f7876cbc-4b3f-406d-855f-f7ba1795a84e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1215 microversion: 2.1 time: 0.097157 Sep 08 19:57:12.648768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 176/361] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:12 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:12.880078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:12.880831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:12.887148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.887833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.888351 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.889209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.889813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.890440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.894277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:12.895015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:12.902271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.902893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.903639 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.904426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:12.904972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:12.905396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:12.934050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2b4b7c21-0b42-42ec-9b78-e206af619c90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/ips" status: 200 len: 150 microversion: 2.1 time: 0.057882 Sep 08 19:57:12.942678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 186/362] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 19:57:12 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:13.061271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:13.070619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-81885a28-52b6-4e2e-a3a5-06429f11c902 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1509 microversion: 2.1 time: 0.181003 Sep 08 19:57:13.072047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 177/363] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:12 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1509 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:13.218026 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-86da42f7-e69a-4db3-a1a8-968b02ed26c6 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Action: 'create', calling method: .version_select at 0x7fef84fdef70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-839273250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaFPi1YaTENiU39ZLxWBEvbp/LZgvZCW60Xu8MlFQAvnsJ0Wo6zD7juzCHJ6RJDmBTEd4AdMUHXRw2b/RGCXHGya5kAv7BEdGka+MoEnvCwNMpxEsfoOMJoPsIUhx4/ZQ=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:13.233730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-86da42f7-e69a-4db3-a1a8-968b02ed26c6 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Getting quotas for project bf41001e3485494e94a2080e4941114a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:13.237560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-86da42f7-e69a-4db3-a1a8-968b02ed26c6 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Getting quotas for user e00ffc7f2df6418ab6328781d9d38f63 and project bf41001e3485494e94a2080e4941114a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:13.271962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-86da42f7-e69a-4db3-a1a8-968b02ed26c6 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057838 Sep 08 19:57:13.280094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 187/364] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 19:57:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:13.395236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-683470116", "imageRef": "b58d2bc3-c0d3-48ac-b722-1015e84fb6dd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-839273250", "networks": [{"uuid": "8bf20b3a-c778-4bad-9450-d23523e7dbb6"}]}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:13.452597 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] validate_networks() for [('8bf20b3a-c778-4bad-9450-d23523e7dbb6', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:57:13.581073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:13.581711 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:13.588093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:13.588582 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:13.589016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:13.589707 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:13.590164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:13.590588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:13.757812 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:13.765926 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b8c8a0b4-cdb4-47ee-8b85-ea348e0031e6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.188793 Sep 08 19:57:13.766498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 188/365] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:13 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:13.786082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:13.786722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:13.792646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:13.793123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:13.793555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:13.794246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:13.794721 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:13.795142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:13.855099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:13.863180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4b581ab3-9d6b-4ce0-8b5a-44fe124b40bd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1267 microversion: 2.1 time: 0.083124 Sep 08 19:57:13.863753 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 189/366] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:13 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:13.980799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:57:13.981628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:57:13.982310 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:57:13.982622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:57:13.983108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:57:13.996635 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:13.997369 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:13.997986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:13.999129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.000186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.000638 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.017214 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Getting quotas for project bf41001e3485494e94a2080e4941114a. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:14.021212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Getting quotas for user e00ffc7f2df6418ab6328781d9d38f63 and project bf41001e3485494e94a2080e4941114a. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:14.031954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:57:14.034188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b58d2bc3-c0d3-48ac-b722-1015e84fb6dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:57:14.085909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-88ca8da9-e4ca-4513-8966-79e66eb86186 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694746 Sep 08 19:57:14.086588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 178/367] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:57:14.093639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:14.094748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:14.097666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e294e88c-20a0-421f-9840-def552929576 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:14.098332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e294e88c-20a0-421f-9840-def552929576 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:14.101917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.102388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.103158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.104172 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.104894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.105912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.109525 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:14.216691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e294e88c-20a0-421f-9840-def552929576 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:14.224062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e294e88c-20a0-421f-9840-def552929576 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1257 microversion: 2.1 time: 0.130347 Sep 08 19:57:14.225294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 179/368] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:14 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1257 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:14.290951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:14.299075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bd01f30b-4331-4f0c-9c89-8d8a86e2c8e7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1515 microversion: 2.1 time: 0.209481 Sep 08 19:57:14.299632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 190/369] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:14 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:14.422674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "febc7e17-b626-4319-be39-111765e7c9d5"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:14.425438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:14.432011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.432487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.432922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.433625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.434076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.434491 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.798716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:14.800996 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:14.808708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.809431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.810312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.811219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:14.811844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:14.812639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:14.980688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e17a2f83-cb8b-48cf-8539-3461d8d2a6b2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561509 Sep 08 19:57:14.988692 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 180/370] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:57:14 2022] POST /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:14.998981 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:15.000582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:15.011424 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:15.012183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:15.012830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:15.013806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:15.014471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:15.015054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:15.085100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:15.094060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b41283ab-ec1c-4f45-8f81-d72c9253599c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1273 microversion: 2.1 time: 0.101584 Sep 08 19:57:15.094629 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 181/371] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:14 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:15.121173 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:15.129385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2488adae-dcd8-4ed1-b014-ff0dd5a21d09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.337559 Sep 08 19:57:15.129951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 191/372] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:14 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:15.252143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:15.252809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:15.260581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:15.261174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:15.261707 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:15.262564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:15.263158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:15.263682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:15.328463 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:15.337675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1fda242b-d9bf-44b6-b3eb-5e3248f2d163 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1309 microversion: 2.1 time: 0.091837 Sep 08 19:57:15.338411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 182/373] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:15 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:15.722482 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-729f4e47-9209-411f-8bb7-d15eec89398a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'create', calling method: .version_select at 0x7fef84e8aa60>, body: {"keypair": {"name": "tempest-keypair-616801241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKzZQWlq8ohlKylPGzmh86eCr05ZfCIeRtDK+h1De4LgjhMomIhkI1PH5wq98MX/bkXBrp2OF7QMl2VJu/qfI3QmYAXxvHVj8FobF9wgEYN68HTM3aohWK9vg6Q876ogTQ=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:15.741912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-729f4e47-9209-411f-8bb7-d15eec89398a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for project 933256f83bff41ff986dd79bd06a6b74. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:15.746582 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-729f4e47-9209-411f-8bb7-d15eec89398a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for user 628b75f16eb14ce1b7deed61ade28b9c and project 933256f83bff41ff986dd79bd06a6b74. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:15.771846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-729f4e47-9209-411f-8bb7-d15eec89398a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055149 Sep 08 19:57:15.772453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 192/374] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 19:57:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:16.117750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:16.118444 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:16.143449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:16.146387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:16.148654 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:16.149649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:16.150664 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:16.151603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:16.152423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:16.153611 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:16.164595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:16.165091 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:16.165522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:16.170534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:16.171057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:16.171488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:16.233481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:16.241732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-aeb572f7-c25c-4668-924b-fc52c64bae13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1273 microversion: 2.1 time: 0.128765 Sep 08 19:57:16.242611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 183/375] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:16 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:16.360520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:16.361182 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:16.367420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:16.367914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:16.368337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:16.369029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:16.369482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:16.369907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:16.412479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:16.422283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-906baa12-1e14-4175-9850-b572401f9f16 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.274047 Sep 08 19:57:16.423032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 193/376] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:16 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:16.441016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:16.448642 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d5c305aa-2143-4b8d-a68d-7d071da0b005 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1309 microversion: 2.1 time: 0.091970 Sep 08 19:57:16.449203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 184/377] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:16 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:17.267220 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:17.268694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:17.281317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:17.282234 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:17.283122 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:17.284771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:17.288054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:17.289353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:17.446151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:17.447363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:17.455688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:17.456403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:17.457057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:17.457971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:17.459126 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:17.459745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:17.478262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:17.500096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:17.517684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4a2ff0f0-175f-4b7d-b99e-c83d9a420bfb tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.253550 Sep 08 19:57:17.521223 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 194/378] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:17 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:17.531999 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:17.532912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:17.540453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:17.541248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:17.541915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:17.542865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:17.544076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:17.545639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:17.718984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:17.738835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bee64f5d-ffc2-4929-9542-da1e718d1f9c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1315 microversion: 2.1 time: 0.213078 Sep 08 19:57:17.750813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 195/379] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:17 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:17.869885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:17.884243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e6b831a6-2e41-4dd2-964b-15b082110cd0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.442385 Sep 08 19:57:17.899118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 185/380] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:17 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:18.125723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-b71fa064-2b93-4011-9fe0-b1c777f02bea req-1fbbea62-eea8-43d8-815b-aa419e69cca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09fc536c-6a97-49d2-8dff-64fa816c5ed7", "tag": "5d83c19c-3e93-40a0-8705-43f7f088a768"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:18.142701 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-b71fa064-2b93-4011-9fe0-b1c777f02bea req-1fbbea62-eea8-43d8-815b-aa419e69cca7 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.146515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-b71fa064-2b93-4011-9fe0-b1c777f02bea req-1fbbea62-eea8-43d8-815b-aa419e69cca7 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.147260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-b71fa064-2b93-4011-9fe0-b1c777f02bea req-1fbbea62-eea8-43d8-815b-aa419e69cca7 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:18.173772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-b71fa064-2b93-4011-9fe0-b1c777f02bea req-1fbbea62-eea8-43d8-815b-aa419e69cca7 service nova] Creating event network-changed:5d83c19c-3e93-40a0-8705-43f7f088a768 for instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 on hv-cinder-83124 Sep 08 19:57:18.179822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-b71fa064-2b93-4011-9fe0-b1c777f02bea req-1fbbea62-eea8-43d8-815b-aa419e69cca7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058294 Sep 08 19:57:18.181043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 196/381] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:18.546898 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:18.547521 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:18.558206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1942730297", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f611bfd9-3041-4cde-9f7b-2bc9eb83eb6a"}], "security_groups": [{"name": "tempest-securitygroup--701758545"}], "key_name": "tempest-keypair-616801241", "user_data": "}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:18.566876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.567373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.567804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:18.568517 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.569193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.569799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:18.684923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] validate_networks() for [('f611bfd9-3041-4cde-9f7b-2bc9eb83eb6a', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:57:18.746116 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:18.754622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1bb7d4de-a34b-4fee-bdd9-d3dad501d717 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.211712 Sep 08 19:57:18.755216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 186/382] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:18 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:18.769280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:18.770135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:18.776550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.782201 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.784742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:18.785876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.786598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.787231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:18.936676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:18.945359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-eb0a59f8-938c-43b7-ad72-511ae263ae94 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.180061 Sep 08 19:57:18.959393 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 187/383] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:18 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:18.967929 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:18.968572 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:18.978050 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.978897 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.979486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:18.980389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:18.981330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:18.981986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:19.125857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:19.135166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f1f33bfb-f898-4509-844d-b432ae394a17 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.171272 Sep 08 19:57:19.135784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 188/384] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:18 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:19.144551 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:57:19.145372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:57:19.146141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:57:19.146877 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:57:19.147490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:57:19.157676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:19.158157 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:19.158590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:19.159352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:19.159800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:19.160221 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:19.176493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for project 933256f83bff41ff986dd79bd06a6b74. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:19.180475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Getting quotas for user 628b75f16eb14ce1b7deed61ade28b9c and project 933256f83bff41ff986dd79bd06a6b74. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:19.191830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:57:19.194256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:57:19.246577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f08e47d6-c750-43b3-948f-2b16f1e31612 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.693399 Sep 08 19:57:19.247299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 197/385] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:57:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:57:19.259218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1575567b-c09b-4480-a303-e5210a271637 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:19.259892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1575567b-c09b-4480-a303-e5210a271637 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:19.272501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:19.331021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1575567b-c09b-4480-a303-e5210a271637 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:19.339179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1575567b-c09b-4480-a303-e5210a271637 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1245 microversion: 2.1 time: 0.083814 Sep 08 19:57:19.339684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 189/386] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:19 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:19.781737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:19.782373 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:19.789518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:19.790051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:19.790597 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:19.791371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:19.791899 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:19.792338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:19.931102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:19.939343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a454822a-4ee7-4c08-8899-6e6b3ae15b16 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.164029 Sep 08 19:57:19.940039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 198/387] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:19 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:19.972637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:19.973887 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:19.981703 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:19.982183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:19.982609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:19.983329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:19.983777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:19.984192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:20.120331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:20.128958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c39f11eb-7b20-403e-8944-5cd5cbc0a151 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.160793 Sep 08 19:57:20.129418 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 190/388] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:19 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:20.159052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:20.159665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:20.165655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:20.166130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:20.166555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:20.167262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:20.167708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:20.168123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:20.301037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:20.309177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-38611b9a-297d-4429-9c12-37dfe2b36597 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.154048 Sep 08 19:57:20.309762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 199/389] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:20 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:20.362381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:20.363067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:20.369929 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:20.370563 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:20.371083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:20.372037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:20.372557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:20.373069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:20.437780 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:20.446210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f27f21ef-321b-49d6-b072-5b7004d0f41c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.087710 Sep 08 19:57:20.447054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 191/390] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:20 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:20.963914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:20.964541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:20.972409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:20.972914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:20.973378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:20.974080 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:20.974532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:20.974985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.121034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:21.129615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6a8d7974-1847-46b4-b95f-2d15e2efa52b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.169941 Sep 08 19:57:21.130333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 200/391] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:20 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:21.153429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:21.154255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:21.160848 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:21.161332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:21.161765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.162486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:21.162998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:21.163422 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.299829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:21.316760 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-93a5ffb0-75aa-44ec-9b8c-eb701d6d3dfe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.167175 Sep 08 19:57:21.317355 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 192/392] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:21 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:21.332657 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:21.333842 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:21.340794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:21.341372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:21.342001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.342810 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:21.343269 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:21.343694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.468312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:21.469208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:21.475387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:21.475875 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:21.477596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.478346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:21.479033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:21.479252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:21.482886 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:21.491211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-74b5d9a9-e7f8-4c4d-bfc2-876c210feabf tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.162915 Sep 08 19:57:21.491911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 201/393] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:21 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:21.496459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 19:57:21.496619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 19:57:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 (ip 10.222.0.44) !!! Sep 08 19:57:21.575243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:21.583390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9267d5d7-ba1a-4dd6-b482-a1e56084b39e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.119018 Sep 08 19:57:21.583964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 193/394] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:21 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:22.155447 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:22.157146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:22.164176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.164807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.165344 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.166171 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.166700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.167154 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.300601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:22.323677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-298caa21-812c-4c6a-806a-3734fbe615d0 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.173915 Sep 08 19:57:22.324480 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 202/395] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:22 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:22.339891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:22.340556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:22.347286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.347774 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.348209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.348922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.349386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.349781 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.478612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:22.486495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-130cb40a-11cd-4758-91c4-42701baec0d9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.150604 Sep 08 19:57:22.487088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 194/396] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:22 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:22.518683 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:22.519597 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:22.526204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.526874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.527409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.528323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.529003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.529521 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.605733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:22.606351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:22.613868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.614575 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.615192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.616048 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:22.616548 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:22.616970 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:22.684852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:22.693660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-840b07c0-b002-4d23-8eb9-a44d6166ab86 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.091681 Sep 08 19:57:22.699326 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:22.705753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 195/397] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:22 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:22.708032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2075f64c-62ca-4624-a717-495bc795fd5f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.193655 Sep 08 19:57:22.717053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 203/398] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:22 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:23.347222 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:23.347860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:23.354864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.355345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.355775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.356460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.356909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.357320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.496958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:23.505828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-68cbf9e1-a4fc-4d63-a403-1449d7d0869e tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.162362 Sep 08 19:57:23.506501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 196/399] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:23 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:23.509824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:23.511202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:23.518067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.518884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.519520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.520425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.521279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.521816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.657331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:23.665961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a3958d7f-3f7e-4c77-9284-6c45bc7fcf8a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.160188 Sep 08 19:57:23.679867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 204/400] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:23 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:23.720426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:23.721217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:23.734321 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.735360 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.736089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.737193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.740146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.740698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.743434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:23.744204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:23.746476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:23.765695 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.766356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.767152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.768127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:23.768754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:23.769423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:23.844494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:23.854377 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a6263da0-2fba-4abf-aad1-f4d204417835 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.137927 Sep 08 19:57:23.855345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 197/401] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:23 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:24.164571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:24.191376 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-06933f01-d532-40e8-b5db-fb6d742a5d03 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.461811 Sep 08 19:57:24.191960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 205/402] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:23 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:24.528742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:24.529375 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:24.531263 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=6 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:24.538364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:24.538884 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:24.539321 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:24.540031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:24.540511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:24.540930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:24.681892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:24.689190 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:24.689833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:24.690171 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-97a21e40-0831-49a4-a140-f0552a9d6a13 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.165392 Sep 08 19:57:24.691086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 198/403] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:24 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:24.696627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:24.697120 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:24.697559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:24.698447 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:24.699084 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:24.699645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:24.856261 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:24.865219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-389b549e-dab3-4e2a-b7e1-eca958fe5f98 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.179889 Sep 08 19:57:24.866365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 206/404] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:24 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:24.879052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:24.880626 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:24.887047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:24.887725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:24.888161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:24.893883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:24.894527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:24.894891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:24.969128 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:24.978396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-173477f7-ba60-4d29-8e38-15bc48798b8b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.103847 Sep 08 19:57:24.979049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 199/405] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:24 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:25.215426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:25.216192 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:25.222749 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.226018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.226452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.227191 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.227639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.228061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.508918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:25.518936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-316e1b1c-8f66-4b7f-be0c-99198434603a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.307558 Sep 08 19:57:25.519519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 207/406] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:25 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:25.715641 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:25.716251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:25.723503 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.724012 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.724420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.725129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.725588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.726015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.849690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:25.850996 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:25.864431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.865253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.865852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.867274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.867880 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.868705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.898534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:25.906803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ba8edf3c-6279-4312-81c9-53f347fcc44b tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.195276 Sep 08 19:57:25.907892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 200/407] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:25 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:25.912952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:25.913722 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:25.920529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.923100 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-319623c1-f852-41ae-b5e7-eb8149878af8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/ips" status: 200 len: 146 microversion: 2.1 time: 0.075625 Sep 08 19:57:25.924120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.924823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.925728 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:25.926341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:25.927264 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:25.934756 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 208/408] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 19:57:25 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/ips => generated 146 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:57:26.002926 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:26.003650 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:26.009908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:26.010629 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:26.011090 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:26.011798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:26.012255 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:26.012680 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:26.048617 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:26.092230 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:26.098184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:26.101787 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f5db2954-432f-435f-95b5-40b24ba54d29 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.192468 Sep 08 19:57:26.102562 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 201/409] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:25 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:26.107000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c3fe8192-49c1-41db-8129-b0b910da7f31 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.108763 Sep 08 19:57:26.111777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 209/410] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:25 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:26.544842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:26.545572 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:26.554084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:26.554791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:26.555359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:26.556274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:26.556881 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:26.557433 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:26.730288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:26.738134 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3a5809d5-711a-4cd8-91d7-4d6b1a1c20f8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.199145 Sep 08 19:57:26.738765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 202/411] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:26 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:26.937745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:26.938237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:26.947094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:26.947684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:26.948186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:26.949280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:26.949519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:26.950293 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.088171 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:27.095774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f84a0568-948a-4099-b449-6330fdc4588a tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.169716 Sep 08 19:57:27.096366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 210/412] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:26 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:27.126057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:27.127412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:27.131619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:27.132234 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:27.134867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:27.135620 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:27.136304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.137062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:27.137540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:27.137969 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.142196 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:27.146934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:27.147440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:27.147883 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.148586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:27.149039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:27.149465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.227740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:27.235460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-defbf54c-c99e-4bad-a85a-cfacc0783d76 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.107624 Sep 08 19:57:27.245114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 211/413] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:27 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:27.280580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:27.289320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-20895aa7-d86d-4339-86dd-36bf1f5f1ef1 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.168480 Sep 08 19:57:27.301490 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 203/414] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:27 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:27.761477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:27.762081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:27.768602 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:27.769074 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:27.769541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.770236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:27.770723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:27.771148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:27.911511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:27.919188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e0b47df3-66d6-4f89-ab05-563870137cf7 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.161654 Sep 08 19:57:27.919746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 212/415] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:27 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:28.028713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df227177-7c7d-4930-976f-00a6e27ce1f6"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:28.031950 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:28.039643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.040387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.041133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.042139 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.042830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.043457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.120186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:28.121424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:28.128187 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.128878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.129476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.130192 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.130665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.131262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.265601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:28.274436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-15c65522-e4be-4560-8719-81817ca93db7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.159187 Sep 08 19:57:28.275047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 213/416] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:28 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:28.279296 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:28.279888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:28.285419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.285893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.286415 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.287045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.287492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.287892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.354048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:28.361917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3ef614b5-5acc-4d35-a99d-6f75876df285 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.085952 Sep 08 19:57:28.362525 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 214/417] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:28 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:28.366856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:28.367444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:28.372917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.373395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.373820 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.374876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.375328 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.375749 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.525047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:28.532993 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fc5449e9-66d4-4e4d-ad43-0b609fcb5459 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.169495 Sep 08 19:57:28.533517 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 215/418] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:28 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:28.945249 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:28.945962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:28.953097 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.953635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.954116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:28.954927 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:28.955434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:28.955905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.098365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:29.106490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cd86adcb-a339-4ea7-a2bd-0c22d39e882d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.166332 Sep 08 19:57:29.107079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 216/419] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:28 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:29.301006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:29.301824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:29.303999 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:29.304820 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=16 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:29.311393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:29.312007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:29.312545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.313405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:29.313975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:29.314504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.335594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=24 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:29.453051 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:29.461468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-50484309-7ae1-4ae4-b382-60e714ced9c8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.166872 Sep 08 19:57:29.462033 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 217/420] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:29 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:29.470506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:29.471146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:29.477044 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:29.477529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:29.477966 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.478676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:29.479135 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:29.479555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.540627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:29.548634 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5cbbdf03-abcc-445a-9fa2-bbaf66a3a0b2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.081885 Sep 08 19:57:29.549207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 218/421] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:29 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:29.555165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:29.555706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:29.561350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:29.561836 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:29.562268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.562984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:29.563439 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:29.563857 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:29.689568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:29.697621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-71528a69-deb3-4dfc-a454-45243bac96ad tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.145920 Sep 08 19:57:29.698178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 219/422] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:29 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:30.131656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:30.132265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:30.138676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.139248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.139762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.140567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.141094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.141595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.277719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:30.286007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0fbbf9f1-5500-4d7d-a2d5-37a1484c8dbe tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.158182 Sep 08 19:57:30.286568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 220/423] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:30 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:30.488144 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:30.489216 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:30.499747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.500556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.501251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.502410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.503211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.503984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.637905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:30.649978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b4659394-23f5-414f-a36a-34827363c394 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.168113 Sep 08 19:57:30.650781 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 221/424] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:30 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:30.655180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:30.655809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:30.662055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.662548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.663016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.663719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.664176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.664612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.729593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:30.737821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d74198b2-9ccc-46cd-a04d-21ca64da1be6 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.086092 Sep 08 19:57:30.738443 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 222/425] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:30 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:30.743160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:30.743765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:30.750305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.750828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.751250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.751948 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:30.752400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:30.752823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:30.881400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:30.889490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1640870e-e16c-4e83-91ef-b66e2c0b2a33 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.150074 Sep 08 19:57:30.890053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 223/426] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:30 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:31.312355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:31.313377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:31.321261 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.321739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.322176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.322902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.323357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.323782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.456937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:31.465043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a4cb067a-5a15-4b4c-b3ae-4263623abf00 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.159096 Sep 08 19:57:31.465578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 224/427] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:31 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:31.676282 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:31.677439 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:31.684970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.685579 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.686115 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.687024 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.687592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.688121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.825438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:31.833874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0c79ec77-d9b9-438e-a743-ad83cf465e37 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.163985 Sep 08 19:57:31.834432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 225/428] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:31 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:31.838857 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:31.839461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:31.845206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.845695 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.846132 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.846867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.847322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.847736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.850257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:31.914037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:31.921829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4eef52c8-ad67-4ab3-9b87-6f49626bfe33 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1249 microversion: 2.1 time: 0.086402 Sep 08 19:57:31.922366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 226/429] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:31 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1249 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:31.926732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:31.927326 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:31.933063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.933578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.934127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:31.934890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:31.935365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:31.935761 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:32.072775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:32.081052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2277f600-f99b-4f8c-b54f-48809d0442c9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.157720 Sep 08 19:57:32.081610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 227/430] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:31 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:32.491160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:32.491825 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:32.499016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:32.499921 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:32.500409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:32.501225 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:32.501728 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:32.502202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:32.643880 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:32.652561 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-192b71e3-5b84-4de2-a540-2b8b48e08905 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.167200 Sep 08 19:57:32.653133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 228/431] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:32 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:32.857149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:32.857784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:32.864107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:32.864572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:32.865004 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:32.865686 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:32.866136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:32.866553 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:32.997835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:33.006243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-38d16dbb-5ed6-4c3f-a6a3-81e10ac67386 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.153614 Sep 08 19:57:33.006978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 229/432] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:32 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:33.011268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:33.011864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:33.017757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.018240 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.018670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.019381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.019830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.020249 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.082971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:33.090972 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ec4647a2-475a-4cc1-a4fc-6c7c33e2f652 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1241 microversion: 2.1 time: 0.083076 Sep 08 19:57:33.091558 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 230/433] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:33 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:33.103755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:33.104539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:33.111787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.112430 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.112864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.113585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.114148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.114570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.243549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:33.252157 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-94d6fdc1-0cc6-4de0-9b44-b72737844611 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.152200 Sep 08 19:57:33.252738 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 231/434] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:33 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:33.342405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-88cdfc04-12ab-429f-8784-084a38bfaea0 req-4cc4cb9b-f259-4a2c-870c-3e301fe150fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:33.353295 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-88cdfc04-12ab-429f-8784-084a38bfaea0 req-4cc4cb9b-f259-4a2c-870c-3e301fe150fa service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.353778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-88cdfc04-12ab-429f-8784-084a38bfaea0 req-4cc4cb9b-f259-4a2c-870c-3e301fe150fa service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.354214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-88cdfc04-12ab-429f-8784-084a38bfaea0 req-4cc4cb9b-f259-4a2c-870c-3e301fe150fa service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.365772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-88cdfc04-12ab-429f-8784-084a38bfaea0 req-4cc4cb9b-f259-4a2c-870c-3e301fe150fa service nova] Creating event network-changed:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 19:57:33.371334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-88cdfc04-12ab-429f-8784-084a38bfaea0 req-4cc4cb9b-f259-4a2c-870c-3e301fe150fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033107 Sep 08 19:57:33.371962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 232/435] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:33.678533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:33.679300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:33.685881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.686549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.693243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.693243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:33.693243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:33.693243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:33.854159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:33.865986 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c2e89278-227c-4c8b-a6e9-1e0ddd47595e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.193308 Sep 08 19:57:33.866581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 233/436] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:33 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:34.030095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:34.030837 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:34.040012 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.040501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.040936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.041745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.042470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.043283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.188215 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:34.197882 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-33d19d5a-a5e4-4eff-92ef-7f1e94ba490f tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.172819 Sep 08 19:57:34.198493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 234/437] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:34 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:34.202921 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:34.203518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:34.209226 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.209675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.210107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.210833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.211288 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.211725 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.273251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:34.285221 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ef62c8d0-3eea-44a7-afed-d51cd8ed5882 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1241 microversion: 2.1 time: 0.085405 Sep 08 19:57:34.285902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 235/438] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:34 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:34.290336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:34.290967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:34.296593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.297071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.297484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.298204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.298723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.299115 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.462912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:34.471491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5162d921-a258-4cf5-a8cd-0210f8752b7b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.184270 Sep 08 19:57:34.500444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 236/439] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:34 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:34.625375 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2416ec77-ca39-4464-95aa-1d887463748c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.600817 Sep 08 19:57:34.625987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 204/440] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:57:28 2022] POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-volume_attachments => generated 194 bytes in 6602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:34.894187 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:34.896342 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:34.903689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.904186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.904814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:34.905883 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:34.906158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:34.906662 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.064125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:35.077997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f2d7f734-6e5d-4256-bf72-4a6efb26e8c1 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.191271 Sep 08 19:57:35.093081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 237/441] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:34 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:35.223126 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:35.224282 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:35.232987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:35.233531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:35.234123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.235124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:35.235584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:35.236076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.309172 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:35.310253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:35.317546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:35.318226 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:35.318788 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.319538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:35.320000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:35.320550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.397366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:35.399323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:35.405840 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4931c065-534a-4c12-b9ad-063052034485 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1297 microversion: 2.1 time: 0.101611 Sep 08 19:57:35.414604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 238/442] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:35 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:35.414803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-15ceb240-e92e-475f-8d3b-253172ce988c tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.190163 Sep 08 19:57:35.414803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 205/443] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:35 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:35.494145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:35.494868 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:35.501540 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:35.502104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:35.502538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.503421 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:35.504049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:35.504480 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:35.591174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a5ae8bd5-1869-48df-9a07-91fbfb23a064 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: .version_select at 0x7fef84ea21f0>, body: {"keypair": {"name": "tempest-keypair-1586047409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgjo7GvJrmhpE4jllO0zITPf0722zrbOKTWXydiAgjmu/OhdtfCMObaKDqZaqlBxiGdQft1n51ztdYGwfv0ORKotHiwoAZDyazHIXpOSFHVwGntFMDPv6cT5wjc+BXjQw=="}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:35.606742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-a5ae8bd5-1869-48df-9a07-91fbfb23a064 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:35.611021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-a5ae8bd5-1869-48df-9a07-91fbfb23a064 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:35.663273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a5ae8bd5-1869-48df-9a07-91fbfb23a064 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.076897 Sep 08 19:57:35.664981 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 206/444] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 19:57:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:35.718539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:35.733914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7da61dc3-6377-4035-8b1f-5b5e0b81f6fe tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.243713 Sep 08 19:57:35.748286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 239/445] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:35 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:36.101734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:36.102420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:36.108947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.109419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.109882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.110542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.111013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.111402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.245381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:36.253331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c90b24b2-4b9a-4a41-ad23-42f0fa35a928 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.156334 Sep 08 19:57:36.253903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 207/446] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:36 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:36.428618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:36.429212 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:36.429294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:36.429986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:36.436592 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.436917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.437190 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.437464 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.437784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.437930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.438555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.438699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.439096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.439255 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.439545 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.440245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.509940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:36.521146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-320ee3b0-c985-48e6-b4fb-667f4c7f9ab7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1315 microversion: 2.1 time: 0.096417 Sep 08 19:57:36.523323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 240/447] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:36 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1315 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:36.590359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:36.598557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bc7b4baa-d0eb-49e0-8d8f-87a65721d640 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.173146 Sep 08 19:57:36.599178 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 208/448] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:36 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:36.759847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:36.760460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:36.769395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.769888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.770311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:36.771041 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:36.771646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:36.772088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.003218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:37.011233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e2df3bcc-28b7-4bb0-b38b-230218bb275b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.255315 Sep 08 19:57:37.011804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 241/449] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:36 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:37.270180 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-921038005", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e992bb3-3c6d-436c-8011-0fb47db3a78e"}], "security_groups": [{"name": "tempest-securitygroup--1550758831"}], "key_name": "tempest-keypair-1586047409", "user_data": "}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:37.275998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:37.276733 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:37.282993 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.283553 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.284052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.284818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.285376 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.285859 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.376006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] validate_networks() for [('9e992bb3-3c6d-436c-8011-0fb47db3a78e', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:57:37.417029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:37.425038 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3d28d522-4f19-4c1c-9c04-29ceb479c0ee tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.152956 Sep 08 19:57:37.425575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 242/450] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:37 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:37.547957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:37.548585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:37.555935 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.556448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.556884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.557584 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.558034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.558453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.574071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:37.621260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:37.630073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-756aa678-64bb-474e-b6f7-8737032623f0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1315 microversion: 2.1 time: 0.088250 Sep 08 19:57:37.630723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 243/451] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:37 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1315 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:37.635197 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:37.637162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:37.643444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.643591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.644011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.644710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.645140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.645556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.765222 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:57:37.765733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:57:37.766403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:57:37.767056 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:57:37.767614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:57:37.777353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.778221 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.778856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.779779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.780270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.780656 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.781727 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:37.791207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c7c3af8e-7b09-4cc1-95a1-bbfe505207c9 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.159451 Sep 08 19:57:37.798967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:57:37.803109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:57:37.807270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 244/452] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:37 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:37.814257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:57:37.816629 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:57:37.864176 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bee3b4ac-3134-456a-a2fc-3798a53b44c5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598311 Sep 08 19:57:37.871669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 209/453] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:57:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:57:37.878786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9b09036f-c98a-4731-bc4a-a5d336523155 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:37.892186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9b09036f-c98a-4731-bc4a-a5d336523155 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:37.918491 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-0d175fef-360f-4bb5-9bfc-ffcdc2b84cd3 req-62ee0aba-07a8-4ddd-b6d3-4da43b448a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "name": "network-vif-plugged", "status": "completed", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:37.935855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-0d175fef-360f-4bb5-9bfc-ffcdc2b84cd3 req-62ee0aba-07a8-4ddd-b6d3-4da43b448a2f service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:37.936484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-0d175fef-360f-4bb5-9bfc-ffcdc2b84cd3 req-62ee0aba-07a8-4ddd-b6d3-4da43b448a2f service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:37.937025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-0d175fef-360f-4bb5-9bfc-ffcdc2b84cd3 req-62ee0aba-07a8-4ddd-b6d3-4da43b448a2f service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:37.948289 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-0d175fef-360f-4bb5-9bfc-ffcdc2b84cd3 req-62ee0aba-07a8-4ddd-b6d3-4da43b448a2f service nova] Creating event network-vif-plugged:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 19:57:37.953860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-0d175fef-360f-4bb5-9bfc-ffcdc2b84cd3 req-62ee0aba-07a8-4ddd-b6d3-4da43b448a2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041044 Sep 08 19:57:37.955355 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 210/454] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:57:37.967992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9b09036f-c98a-4731-bc4a-a5d336523155 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:37.976736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9b09036f-c98a-4731-bc4a-a5d336523155 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1241 microversion: 2.1 time: 0.102496 Sep 08 19:57:37.977393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 245/455] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:37 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:38.034559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:38.035345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:38.042000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.042487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.043032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.043728 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.044298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.044603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.182236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:38.190367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d3a7eb4b-0871-4dc3-932e-9e91c4b48579 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.160249 Sep 08 19:57:38.191001 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 211/456] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:38 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:38.448180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:38.448779 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:38.455010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.455518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.455950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.456654 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.457102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.457523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.605775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:38.613900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ade41008-6cb0-4312-a77d-e591ef02e7a5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.169798 Sep 08 19:57:38.614708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 246/457] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:38 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:38.653245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:38.653887 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:38.661546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.662026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.662631 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.663672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.664272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.664843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.772719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:38.786990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a5c08a96-60fe-443e-bb28-79bc05e396a4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1303 microversion: 2.1 time: 0.137472 Sep 08 19:57:38.788133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 212/458] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:38 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1303 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:38.814606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:38.815689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:38.822418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.823341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.823901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:38.824722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:38.825388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:38.826027 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.000419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:39.001277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:39.007958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.008644 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.009223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.010078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.010960 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.011386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.044021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:39.052229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e6314b81-c8b7-44a3-8486-2d279cfe4495 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.241512 Sep 08 19:57:39.052848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 247/459] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:38 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:39.103375 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:39.111281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1b0e8673-8cf1-4a88-8524-3749c03fd8cb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1293 microversion: 2.1 time: 0.115422 Sep 08 19:57:39.111859 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 213/460] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:38 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:39.213162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:39.214488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:39.220725 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.221486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.221758 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.222532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.223031 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.223410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.377165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:39.385652 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7db7e70b-0207-4a76-8ae5-8c5f2ca916d3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.176393 Sep 08 19:57:39.386244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 248/461] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:39 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:39.638563 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:39.639135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:39.645433 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.645916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.646346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.647064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.647513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.647933 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.795952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:39.806187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ab279a0a-c812-4dd0-b888-1b013c3cd8f5 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.171588 Sep 08 19:57:39.806784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 214/462] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:39 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:39.812397 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:39.813088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:39.819709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.820269 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.820768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.821552 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:39.822008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:39.822433 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:39.958092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:39.966096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f03e0b4b-0cf1-4668-9b7d-af6abfd42030 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.157543 Sep 08 19:57:39.966674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 249/463] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:39 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:40.079847 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:40.080490 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:40.086863 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.087389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.087823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.088522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.088975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.089397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.140878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:40.141610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:40.147779 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.148262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.148692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.149384 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.149833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.150256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.211849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:40.219551 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9d7c2d81-d43f-4d64-8f83-5c88f842d348 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1293 microversion: 2.1 time: 0.082596 Sep 08 19:57:40.220331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 250/464] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:40 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:40.223005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:40.230948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-42ff166d-2592-4393-adaa-eeaa3d749a47 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.159860 Sep 08 19:57:40.231531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 215/465] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:40 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:40.408860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:40.409479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:40.416320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.416821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.417257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.417958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.418415 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.418887 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.553040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:40.561247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cb2eef0a-b25e-48d9-9e68-e6521a3232a4 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.156403 Sep 08 19:57:40.561809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 251/466] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:40 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:40.829326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:40.829931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:40.837027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.837516 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.837947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.838736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.839188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.839580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.989028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:40.989593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:40.992899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:40.996257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.996675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.997162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:40.997865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:40.998311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:40.998762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.001489 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9dea9e62-70c0-43c6-9d1a-3f0943b12139 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.176330 Sep 08 19:57:41.002053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 216/467] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:40 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:41.130417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:41.139130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-da4e1985-1460-48be-95de-5b8543997a07 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.154049 Sep 08 19:57:41.139720 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 252/468] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:40 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:41.246540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:41.247813 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:41.257465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:41.258360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:41.258509 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.258893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.259322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.259991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.260471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.260863 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.264639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.265125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.265561 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.266263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.266735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.267166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.322311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:41.330153 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ec47148c-f3f1-43da-8a3c-6a636f167cea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1293 microversion: 2.1 time: 0.090349 Sep 08 19:57:41.330840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 217/469] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:41 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:41.397847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:41.406317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d5a20c0a-3969-44cb-bf7c-bf017ac263cd tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.155273 Sep 08 19:57:41.406919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 253/470] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:41 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:41.587809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:41.588540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:41.596731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.597370 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.597939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.598888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.599496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.600054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:41.743087 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:41.751622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-24c5ef04-4657-4b58-a6c0-33c29f59a600 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.170238 Sep 08 19:57:41.752399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 218/471] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:41 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:41.980624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-080533f5-f762-4098-ae90-ea3e85031eff req-244aa6bf-69af-4452-bc73-fb7d0ef43509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fc536c-6a97-49d2-8dff-64fa816c5ed7", "name": "network-vif-plugged", "status": "completed", "tag": "5d83c19c-3e93-40a0-8705-43f7f088a768"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:41.986716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:41.990872 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-080533f5-f762-4098-ae90-ea3e85031eff req-244aa6bf-69af-4452-bc73-fb7d0ef43509 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:41.991440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-080533f5-f762-4098-ae90-ea3e85031eff req-244aa6bf-69af-4452-bc73-fb7d0ef43509 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:41.991794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-080533f5-f762-4098-ae90-ea3e85031eff req-244aa6bf-69af-4452-bc73-fb7d0ef43509 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.003918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-080533f5-f762-4098-ae90-ea3e85031eff req-244aa6bf-69af-4452-bc73-fb7d0ef43509 service nova] Creating event network-vif-plugged:5d83c19c-3e93-40a0-8705-43f7f088a768 for instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 on hv-cinder-83124 Sep 08 19:57:42.008934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-080533f5-f762-4098-ae90-ea3e85031eff req-244aa6bf-69af-4452-bc73-fb7d0ef43509 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032263 Sep 08 19:57:42.009722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 254/472] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:42.024499 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:42.025107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:42.031741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.032228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.032660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.033358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.033811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.034229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.171340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:42.172198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:42.178807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.179400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.179943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.180697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.181079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.181498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.245667 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:42.266457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9c6e66fe-b186-4e2b-ad8b-c2870f66f347 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.245905 Sep 08 19:57:42.267281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 219/473] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:42 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:42.322688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:42.331279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-24552620-c304-44fb-9de3-f662d8304b10 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.164233 Sep 08 19:57:42.331840 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 255/474] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:42 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:42.353085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:42.353689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:42.359799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.360280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.360710 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.361404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.361850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.362271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.429232 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:42.429959 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:42.436436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.437023 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.437522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.438299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.438854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.439335 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.583811 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:42.592791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a86ef317-4e31-4700-9c6d-5fc0d7d774a7 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.167425 Sep 08 19:57:42.593736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 256/475] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:42 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:42.682964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:42.685944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:42.692556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-52cffdf7-e401-4fe4-870a-10e9c57de717 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1293 microversion: 2.1 time: 0.343543 Sep 08 19:57:42.693217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 220/476] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:42 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1293 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:42.773783 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:42.774396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:42.780809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.781295 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.781723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.782411 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:42.782899 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:42.783322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:42.915774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:42.923467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2327a3cb-1018-40c1-9186-d37d2d77a8bb tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.153833 Sep 08 19:57:42.924036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 257/477] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:42 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:43.035342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-5689c211-c9ba-422a-9c76-ca7e4821080d req-ce530d88-f91d-44bc-a4aa-b68b3b3cbad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcbbdca-e7b1-4512-a75e-486b36e13cf8", "tag": "f28431b5-807d-4361-995f-3aac58e76ed9"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:43.047432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5689c211-c9ba-422a-9c76-ca7e4821080d req-ce530d88-f91d-44bc-a4aa-b68b3b3cbad4 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.047942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5689c211-c9ba-422a-9c76-ca7e4821080d req-ce530d88-f91d-44bc-a4aa-b68b3b3cbad4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.048381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5689c211-c9ba-422a-9c76-ca7e4821080d req-ce530d88-f91d-44bc-a4aa-b68b3b3cbad4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.060396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-5689c211-c9ba-422a-9c76-ca7e4821080d req-ce530d88-f91d-44bc-a4aa-b68b3b3cbad4 service nova] Creating event network-changed:f28431b5-807d-4361-995f-3aac58e76ed9 for instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 on hv-cinder-83124 Sep 08 19:57:43.065545 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-5689c211-c9ba-422a-9c76-ca7e4821080d req-ce530d88-f91d-44bc-a4aa-b68b3b3cbad4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034672 Sep 08 19:57:43.066145 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 221/478] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:43.290967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:43.291575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:43.298008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.298498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.298961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.299655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.300113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.300540 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.355022 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:43.355719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:43.362065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.362564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.363100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.364154 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.364671 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.365084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.436036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:43.444109 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a7c88d61-0e83-4cc3-aea4-4ce18ffe360e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1261 microversion: 2.1 time: 0.158344 Sep 08 19:57:43.444687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 258/479] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:43 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:43.497987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:43.510270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a998a622-28ab-492a-9796-7aff7abeaaa5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.159895 Sep 08 19:57:43.511175 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 222/480] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:43 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:43.616671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:43.617364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:43.623816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.624673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.625108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.625816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.626264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.626761 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.716606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:43.717507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:43.730062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.730906 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.731494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.732398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.733006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.734528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.805651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:43.812664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:43.813324 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3e3331c1-3cb5-45c5-aee4-5a52b991b916 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1293 microversion: 2.1 time: 0.102359 Sep 08 19:57:43.813901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 223/481] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:43 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:43.820752 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0779fa49-4e27-4c2e-8e06-440fbdbee3fa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.208089 Sep 08 19:57:43.821307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 259/482] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:43 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:43.947350 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:43.948102 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:43.954973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.955457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.955886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:43.956574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:43.957000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:43.957438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.087573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:44.096855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-dd0b178a-42c9-444b-a0b3-2689d2451077 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.153564 Sep 08 19:57:44.097426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 224/483] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:43 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:44.468633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:44.469235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:44.476803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.477560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.478315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.479273 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.480040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.480669 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.541680 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:44.542504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:44.551217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.552008 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.552816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.554370 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.555476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.556040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.631310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:44.640487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-135b66d7-2829-4d6a-8412-fdfdc71ed096 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1445 microversion: 2.1 time: 0.176823 Sep 08 19:57:44.641515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 260/484] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:44 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:44.663516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:44.664229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:44.670369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.670983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.671487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.672232 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.672748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.673169 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.692121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:44.700163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e86cb5f4-f295-4f09-8cea-278ea0dab8dc tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.163368 Sep 08 19:57:44.701194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 225/485] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:44 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:44.805003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:44.808510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:44.819059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c9b727e2-2532-4442-ba7f-28b230cbc222 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1445 microversion: 2.1 time: 0.158868 Sep 08 19:57:44.819821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 261/486] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:44 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:44.835909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:44.836522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:44.838593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:44.844352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.844832 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.845243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.845351 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:44.845977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.846110 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:44.846430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.846974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.853391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.853391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.853650 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.854322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:44.854801 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:44.855214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:44.917753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:44.925176 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f43d13df-42a5-422c-ac58-8c86a91a83c9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1293 microversion: 2.1 time: 0.093222 Sep 08 19:57:44.926086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 226/487] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:44 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:44.992806 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:45.000772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ddd84b6c-7868-42af-b19a-482d203aca95 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1315 microversion: 2.1 time: 0.159855 Sep 08 19:57:45.001488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 262/488] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:44 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:45.120117 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:45.120711 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:45.127829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.128316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.128744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.129419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.129965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.130374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.268504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:45.277093 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-77e70ccb-8e24-40ac-a7d9-994fc7ea7223 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.161033 Sep 08 19:57:45.277672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 227/489] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:45 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:45.420335 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-db7f66db-13d2-4af1-abe0-d6a9266643c8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:45.426176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db7f66db-13d2-4af1-abe0-d6a9266643c8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.426693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db7f66db-13d2-4af1-abe0-d6a9266643c8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.427127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db7f66db-13d2-4af1-abe0-d6a9266643c8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.492278 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-db7f66db-13d2-4af1-abe0-d6a9266643c8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Going to try to stop instance {{(pid=120484) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 19:57:45.542405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-db7f66db-13d2-4af1-abe0-d6a9266643c8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action" status: 202 len: 0 microversion: 2.1 time: 0.125767 Sep 08 19:57:45.546818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 263/490] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 19:57:45 2022] POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 19:57:45.553605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:45.554458 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:45.562319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.562857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.563282 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.564220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.564874 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.575896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.722656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:45.723753 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:45.730362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.731168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.731848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.732798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.733460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.734094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.772799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:45.782664 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4d77e2ba-cbc4-471a-810c-901f9c28e61d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.233772 Sep 08 19:57:45.790107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 228/491] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:45 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:45.947928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:45.948485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:45.970265 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.972885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.975772 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:45.976756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:45.979591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:45.980288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.070052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:46.079883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-28116eed-d31e-4425-a006-669e7c1128e1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1299 microversion: 2.1 time: 0.135707 Sep 08 19:57:46.080682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 229/492] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:45 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:46.085035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:46.085645 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:46.091664 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.092156 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.092591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.093292 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.093746 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.094166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.153178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:46.162823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3e7e0687-b43e-4bb1-8a5c-d92314542df0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.444242 Sep 08 19:57:46.163705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 264/493] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:45 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:46.169823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-198ef48d-e810-4524-b5ce-f539e50586e7 req-85c039d3-8a16-4de6-8c0c-538f99f13c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "name": "network-vif-plugged", "status": "completed", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:46.179691 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-198ef48d-e810-4524-b5ce-f539e50586e7 req-85c039d3-8a16-4de6-8c0c-538f99f13c03 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.180312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-198ef48d-e810-4524-b5ce-f539e50586e7 req-85c039d3-8a16-4de6-8c0c-538f99f13c03 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.180843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-198ef48d-e810-4524-b5ce-f539e50586e7 req-85c039d3-8a16-4de6-8c0c-538f99f13c03 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.192639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-198ef48d-e810-4524-b5ce-f539e50586e7 req-85c039d3-8a16-4de6-8c0c-538f99f13c03 service nova] Creating event network-vif-plugged:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 19:57:46.197878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-198ef48d-e810-4524-b5ce-f539e50586e7 req-85c039d3-8a16-4de6-8c0c-538f99f13c03 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Sep 08 19:57:46.199270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 265/494] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:46.230525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:46.238431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-25bf4f64-f4ed-45b1-8e50-29effd2d6781 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1465 microversion: 2.1 time: 0.156926 Sep 08 19:57:46.238975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 230/495] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:46 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:46.286382 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:46.287101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:46.293331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.293904 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.294470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.295187 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.295623 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.296044 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.299608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:46.300219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:46.306943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.307430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.307856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.308547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.308995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.309402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.323146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 19:57:46.425138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-08af50ac-fab6-4366-8406-acd44c58e3c6 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "DELETE /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 204 len: 0 microversion: 2.1 time: 0.142677 Sep 08 19:57:46.425918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 266/496] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 19:57:46 2022] DELETE /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 19:57:46.435914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:46.437142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:46.446143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.446845 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.447776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.448907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.450372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.450372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.491995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:46.500809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-642cc0c9-814c-405f-9e0b-8dbc9559ff60 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.205027 Sep 08 19:57:46.501383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 231/497] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:46 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:46.806192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:46.806852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:46.813450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.813977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.814410 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.815157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:46.815616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:46.816037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:46.951689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:46.958903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:46.961326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-161b5d53-35c0-443c-bcb7-88ddeacc2f8f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.159309 Sep 08 19:57:46.962104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 232/498] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:46 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:46.982242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2383f467-49d0-4b5c-b4a5-e5628aabaff4 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1471 microversion: 2.1 time: 0.551364 Sep 08 19:57:46.982933 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 267/499] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:46 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:47.103013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:47.103619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:47.109918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.110402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.110872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.111559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.112014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.112411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.174633 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:47.182622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-142b8fd6-0979-4a09-b20d-403bb0139c05 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1299 microversion: 2.1 time: 0.083558 Sep 08 19:57:47.183408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 233/500] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:47 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:47.187052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:47.187691 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:47.193862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.194363 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.194875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.195679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.196173 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.196555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.383124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:47.391676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d9f7e811-6d91-4ae9-a048-6ca155197be4 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.209084 Sep 08 19:57:47.397153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 268/501] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:47 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:47.423464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-d42b3ef0-1ac3-4bcd-96f9-f6e0d330798d req-529f9781-0e1b-46c5-9f21-815c15653851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:47.432826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d42b3ef0-1ac3-4bcd-96f9-f6e0d330798d req-529f9781-0e1b-46c5-9f21-815c15653851 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.433301 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d42b3ef0-1ac3-4bcd-96f9-f6e0d330798d req-529f9781-0e1b-46c5-9f21-815c15653851 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.433720 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d42b3ef0-1ac3-4bcd-96f9-f6e0d330798d req-529f9781-0e1b-46c5-9f21-815c15653851 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.445467 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-d42b3ef0-1ac3-4bcd-96f9-f6e0d330798d req-529f9781-0e1b-46c5-9f21-815c15653851 service nova] Creating event network-changed:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 19:57:47.450846 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-d42b3ef0-1ac3-4bcd-96f9-f6e0d330798d req-529f9781-0e1b-46c5-9f21-815c15653851 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031032 Sep 08 19:57:47.451435 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 234/502] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:47.524633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:47.525333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:47.531632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.532069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.532494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.533184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.533627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.534053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.759728 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:47.775412 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9b528ecb-9f63-46d9-a5ea-859a84d4b80c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.252965 Sep 08 19:57:47.776760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 269/503] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:47 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:47.985584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:47.986622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:47.992533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:47.993347 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=10 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:47.995835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:47.996376 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:47.996879 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:47.997850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.006407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:48.007115 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:48.009396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:48.010701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.012536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.021699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.023591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.024803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.025618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.027380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.027831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.267857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:48.278983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6255f8c5-29c6-4a71-88ff-1e0eed8cd985 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.297894 Sep 08 19:57:48.280052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 235/504] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:47 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:48.284856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:48.285454 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:48.293908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.294688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.295273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.296402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.297678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.298274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.392443 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:48.403702 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-da5ac223-ae8e-435b-9c58-c5974c7db804 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1299 microversion: 2.1 time: 0.122376 Sep 08 19:57:48.404969 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 236/505] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:48 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:48.424797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:48.425364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:48.431523 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.432009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.432434 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.433132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.433843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.433977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.458499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:48.471111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-93949bed-6f7d-4522-864b-7ad1c6e29218 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1471 microversion: 2.1 time: 0.468430 Sep 08 19:57:48.471727 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 270/506] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:48 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1471 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:48.578085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:48.588337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7c3cff3e-658f-429a-b550-29ce5e7bebf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.168105 Sep 08 19:57:48.588950 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 237/507] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:48 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:48.799804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:48.800342 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:48.807786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.808497 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.808936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:48.809655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:48.810114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:48.810540 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.063408 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:49.071532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3ce4bb4b-ff45-4d97-82da-77df88bbf708 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.275650 Sep 08 19:57:49.072107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 271/508] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:48 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:49.301745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:49.302266 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:49.309323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.309754 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.310188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.310920 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.311378 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.311800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.427540 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:49.428314 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:49.434755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.435311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.435850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.436511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.436959 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.437380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.461774 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:49.464320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:49.471694 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-94edafb8-bc0d-4241-b6d0-f5455f87d63a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.173994 Sep 08 19:57:49.472260 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 238/509] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:49 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:49.477025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-231f33c2-c508-4138-a116-e8259d8953f4 req-cf3b9056-d025-45d4-8b10-5b9d3e1f627c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fc536c-6a97-49d2-8dff-64fa816c5ed7", "name": "network-vif-deleted", "tag": "5d83c19c-3e93-40a0-8705-43f7f088a768"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:49.488794 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-231f33c2-c508-4138-a116-e8259d8953f4 req-cf3b9056-d025-45d4-8b10-5b9d3e1f627c service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.489500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-231f33c2-c508-4138-a116-e8259d8953f4 req-cf3b9056-d025-45d4-8b10-5b9d3e1f627c service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.490726 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-231f33c2-c508-4138-a116-e8259d8953f4 req-cf3b9056-d025-45d4-8b10-5b9d3e1f627c service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.504305 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-231f33c2-c508-4138-a116-e8259d8953f4 req-cf3b9056-d025-45d4-8b10-5b9d3e1f627c service nova] Creating event network-vif-deleted:5d83c19c-3e93-40a0-8705-43f7f088a768 for instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 on hv-cinder-83124 Sep 08 19:57:49.509833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-231f33c2-c508-4138-a116-e8259d8953f4 req-cf3b9056-d025-45d4-8b10-5b9d3e1f627c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036210 Sep 08 19:57:49.510578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 239/510] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:49.515768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:49.516458 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:49.522835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.523317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.523864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.524514 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.524965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.525381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.583695 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:49.589662 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:49.603239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e6b2ccd3-25eb-46f9-b9ab-31c7f789b087 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1429 microversion: 2.1 time: 0.090858 Sep 08 19:57:49.604212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 240/511] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:49 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:49.606230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9b435377-8574-4e39-919e-8f368a1341de tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.182226 Sep 08 19:57:49.608141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 272/512] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:49 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:49.612786 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:49.613341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:49.619832 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.620313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.620744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.621423 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:49.622061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:49.622507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:49.761508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:49.772290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-50e3bde7-b9b3-42df-b5f7-e19b6863f1ff tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.164791 Sep 08 19:57:49.773066 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 241/513] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:49 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:50.098533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:50.099691 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:50.106620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.107140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.107571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.108254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.108731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.109149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.241849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:50.250365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0ade7e07-390f-4043-8660-713af7bae950 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.158296 Sep 08 19:57:50.250976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 273/514] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:50 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:50.498286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:50.499268 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:50.506333 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.506880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.507315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.508007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.508464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.508885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.627171 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:50.627724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:50.634438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.634968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.635409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.636277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.636734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.637248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.653822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:50.662534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cab40a95-b7e7-4218-a666-3857cd396a29 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.168191 Sep 08 19:57:50.663123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 242/515] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:50 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:50.667568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:50.668173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:50.674271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.674785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.675235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.675928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.676354 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.676983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.702099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:50.710615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1cafaf53-7c7d-4fd3-b3c8-c05b4a02d1b8 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1429 microversion: 2.1 time: 0.087880 Sep 08 19:57:50.711560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 274/516] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:50 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:50.795473 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:50.796105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:50.802694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.803195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.803637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.804343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:50.804817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:50.805246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:50.817187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:50.825030 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4f077c51-e837-4efc-8594-e4752986096b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.160945 Sep 08 19:57:50.825594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 243/517] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:50 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:50.934518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:50.942899 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5faa8ded-f3a7-4cad-8745-fccd9f0ea3b7 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.151346 Sep 08 19:57:50.943472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 275/518] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:50 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:51.272406 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:51.273010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:51.279422 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.279903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.280348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.281050 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.281495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.281909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.429360 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:51.437269 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1cf08bc9-ff6e-4ced-8fcd-87b88dcb6acd tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.168886 Sep 08 19:57:51.437925 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 244/519] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:51 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:51.686182 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:51.687138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:51.694150 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.694656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.695095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.695878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.707120 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.707708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.726913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:51.734060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:51.734694 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:51.748715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.749644 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.750130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.750879 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.751344 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.751770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.835282 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:51.845561 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5ddbccfa-68e0-4c64-8608-d34fbf7d3654 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1300 microversion: 2.1 time: 0.115860 Sep 08 19:57:51.851297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 245/520] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:51 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:51.861390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:51.863216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:51.883246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.887381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.887904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.888727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:51.889259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:51.889757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:51.968486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:51.989431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cadd1b7e-230e-49dd-b363-4c8ccda75921 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.307504 Sep 08 19:57:51.995436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 276/521] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:51 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:52.000831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-3a484d42-3b2a-4e9c-b946-15c98af7e54c req-9bc84bf1-4067-4bc5-992c-1875fe17de4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5070d059-02b2-46a5-84d5-020a048682fe", "tag": "50c1ecbf-f38a-4fc2-a354-d8665899070b"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:52.016390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3a484d42-3b2a-4e9c-b946-15c98af7e54c req-9bc84bf1-4067-4bc5-992c-1875fe17de4e service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.016873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3a484d42-3b2a-4e9c-b946-15c98af7e54c req-9bc84bf1-4067-4bc5-992c-1875fe17de4e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.017308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3a484d42-3b2a-4e9c-b946-15c98af7e54c req-9bc84bf1-4067-4bc5-992c-1875fe17de4e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.036187 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-3a484d42-3b2a-4e9c-b946-15c98af7e54c req-9bc84bf1-4067-4bc5-992c-1875fe17de4e service nova] Creating event network-changed:50c1ecbf-f38a-4fc2-a354-d8665899070b for instance 5070d059-02b2-46a5-84d5-020a048682fe on hv-cinder-83124 Sep 08 19:57:52.041304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-3a484d42-3b2a-4e9c-b946-15c98af7e54c req-9bc84bf1-4067-4bc5-992c-1875fe17de4e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044453 Sep 08 19:57:52.041915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 277/522] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:52.047636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:52.048340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:52.053621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:52.056138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.057591 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.058364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.059535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.060156 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.060744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.061770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e5246fc5-3d75-4333-a968-c8cc455bb159 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.209062 Sep 08 19:57:52.062359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 246/523] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:51 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:52.199894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:52.207981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a0989e26-b1e0-4f61-a689-2c31271c04c5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.164703 Sep 08 19:57:52.208615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 278/524] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:52 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:52.461450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:52.461992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:52.468534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.469021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.469456 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.470151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.470608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.471065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.652151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:52.664549 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5501af98-9759-4e9e-b287-84a05ba29835 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1357 microversion: 2.1 time: 0.206157 Sep 08 19:57:52.665081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 247/525] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:52 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:52.867563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:52.868133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:52.874785 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.875247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.875673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.876362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.876811 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.877233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.909044 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:52.909653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:52.910100 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:52.911185 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lazy-loading 'fault' on Instance uuid 09fc536c-6a97-49d2-8dff-64fa816c5ed7 {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 19:57:52.950955 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55fcf3af65c34cd88dc79b4df8429771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36405a47124471b9ebd558705ec14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:52.958951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-443bc52c-9473-4059-a31a-11b036f64669 tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 200 len: 1305 microversion: 2.1 time: 0.095365 Sep 08 19:57:52.959530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 279/526] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:52 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:53.017633 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:53.018163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:53.025055 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.025569 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.025969 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.026685 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.027143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.027601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.084628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:53.085240 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:53.092098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.092604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.093041 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.093740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.094180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.094861 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.173211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:53.182096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b214d963-e285-43a9-ab42-952c764ecce7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.168373 Sep 08 19:57:53.186719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 248/527] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:53 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:53.232791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:53.234115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:53.241553 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.242199 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.242942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.243811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.244331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.244837 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.391270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:53.399844 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d42c983e-f329-4d6f-b9ea-17c1591fdc4e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.171177 Sep 08 19:57:53.414683 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 249/528] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:53 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:53.522714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:53.531036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3053d6e7-93ea-460f-af92-145ef1aa31e4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.450354 Sep 08 19:57:53.531586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 280/529] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:53 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:53.689739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:53.690351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:53.696761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.697248 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.697677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.698368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.698894 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.699332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.831306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:53.839041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bb30e034-1beb-4435-91ab-1ec751c76278 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1548 microversion: 2.1 time: 0.153238 Sep 08 19:57:53.839607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 250/530] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:53 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:53.862218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:53.862856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:53.869237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.869814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.870149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.870881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.871331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.871753 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.981825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:53.982923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] [instance: 09fc536c-6a97-49d2-8dff-64fa816c5ed7] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:53.989313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.989909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.990406 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:53.991219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:53.991739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:53.992534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.008957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:54.009781 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] HTTP exception thrown: Instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 could not be found. Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Request method failure captured: Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 HTTP/1.1 Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkkVvJuZVYJP7BrRTHdaS4Ajr0S6g-pTZ0y2yDXFiQePzVJBhQhyIKtitN4Tk3LVJhLjBFnUE1OJp5Xzpz4lCg42ewCyUmrSFuPK3Z9XMh1VUgX0fbNQhT6N2Ob4xGtm4z4RamrcxcCgp3l7AEkIKmttikOAmvi2TgUpotS5P13d7Z4 Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: fa36405a47124471b9ebd558705ec14f Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-VolumesNegativeTest-2059334991 Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:57:54.011582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa36405a47124471b9ebd558705ec14f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fa36405a47124471b9ebd558705ec14f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fa36405a47124471b9ebd558705ec14f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fa36405a47124471b9ebd558705ec14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-VolumesNegativeTest-2059334991 Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: fa36405a47124471b9ebd558705ec14f Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-VolumesNegativeTest-2059334991 Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-VolumesNegativeTest-2059334991-project Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 55fcf3af65c34cd88dc79b4df8429771 Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-VolumesNegativeTest-2059334991-project Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 could not be found. Sep 08 19:57:54.012890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '09fc536c-6a97-49d2-8dff-64fa816c5ed7'} Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 could not be found. Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:57:54.013621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 could not be found. Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 could not be found. Sep 08 19:57:54.015114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:57:54.017150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] Returning 404 to user: Instance 09fc536c-6a97-49d2-8dff-64fa816c5ed7 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:57:54.017150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b9ecef01-4f89-460c-963d-99028535dffa tempest-VolumesNegativeTest-2059334991 tempest-VolumesNegativeTest-2059334991-project] 10.222.0.44 "GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7" status: 404 len: 111 microversion: 2.1 time: 0.035270 Sep 08 19:57:54.017150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 251/531] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:53 2022] GET /compute/v2.1/servers/09fc536c-6a97-49d2-8dff-64fa816c5ed7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:57:54.025166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6ca868e3-d781-4e6a-9a0c-95d645a45ddc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1548 microversion: 2.1 time: 0.166751 Sep 08 19:57:54.025774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 281/532] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:53 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:54.047701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:54.052719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:54.053500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Searching by: {'deleted': False, 'project_id': 'bf41001e3485494e94a2080e4941114a'} {{(pid=120485) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 19:57:54.061161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.061646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.062080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.062845 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.063982 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.064594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.157966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.multi_cell_list [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120485) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 19:57:54.159084 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-7c2c520e-cf04-47b6-85fa-b8d72ff6cb7a req-4daf3316-584a-464b-a4ce-d95dcb4a206b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bcbbdca-e7b1-4512-a75e-486b36e13cf8", "name": "network-vif-plugged", "status": "completed", "tag": "f28431b5-807d-4361-995f-3aac58e76ed9"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:54.172286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-7c2c520e-cf04-47b6-85fa-b8d72ff6cb7a req-4daf3316-584a-464b-a4ce-d95dcb4a206b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.173118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-7c2c520e-cf04-47b6-85fa-b8d72ff6cb7a req-4daf3316-584a-464b-a4ce-d95dcb4a206b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.173773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-7c2c520e-cf04-47b6-85fa-b8d72ff6cb7a req-4daf3316-584a-464b-a4ce-d95dcb4a206b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.187205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-7c2c520e-cf04-47b6-85fa-b8d72ff6cb7a req-4daf3316-584a-464b-a4ce-d95dcb4a206b service nova] Creating event network-vif-plugged:f28431b5-807d-4361-995f-3aac58e76ed9 for instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 on hv-cinder-83124 Sep 08 19:57:54.195649 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-7c2c520e-cf04-47b6-85fa-b8d72ff6cb7a req-4daf3316-584a-464b-a4ce-d95dcb4a206b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042951 Sep 08 19:57:54.196902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 282/533] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:54.214529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:54.216148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:54.226349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.227718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.228218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.228990 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.229508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.230018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.272412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cc78a7b3-25da-4e5b-a7f4-11bf2947bea5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.228375 Sep 08 19:57:54.273235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 252/534] 10.222.0.44 () {58 vars in 1125 bytes} [Thu Sep 8 19:57:54 2022] GET /compute/v2.1/servers => generated 342 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:54.284744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:54.285367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:54.291577 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.292070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.292513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.293211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.293668 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.294090 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.385028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:54.396596 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-adbbec6b-c383-45bb-a96b-0b1fd1068aed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.191883 Sep 08 19:57:54.397505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 283/535] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:54 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:54.425884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:54.426726 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:54.433902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.434511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.435178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.435953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.436478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.436978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.447799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:54.456947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-11dbcff9-904c-4ea2-aa26-bc9882413914 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1548 microversion: 2.1 time: 0.176037 Sep 08 19:57:54.457733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 253/536] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:54 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:54.553442 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:54.554512 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:54.561060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.561979 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.562597 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.563803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:54.564261 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:54.565078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:54.611241 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:54.626144 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-02d96888-e04f-4bb5-a0f2-b012bd2ce124 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.207056 Sep 08 19:57:54.627443 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 284/537] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:54 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:54.739193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:54.753523 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f2eeb6a8-6bd6-43c7-b517-8316875f7da1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.198047 Sep 08 19:57:54.754185 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 254/538] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:54 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:55.431029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:55.431703 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:55.438243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:55.438770 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:55.439201 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:55.439896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:55.440348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:55.443038 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:55.588522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:55.597652 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8e55d661-57e7-4ee8-a49b-703518fefde0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.170754 Sep 08 19:57:55.598302 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 285/539] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:55 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:55.649334 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:55.650829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:55.659513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:55.660218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:55.660913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:55.661808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:55.662331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:55.662999 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:55.778372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:55.779009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:55.789713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:55.790564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:55.791346 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:55.793188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:55.793711 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:55.794485 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:55.814528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:55.823160 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f0758d4e-05e8-492b-9ee8-fad1ea34130c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.177700 Sep 08 19:57:55.824383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 255/540] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:55 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:55.952251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:55.961438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ff09675a-28cb-4b6f-9323-de4c769be413 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.187033 Sep 08 19:57:55.962388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 286/541] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:55 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:56.116090 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5254fb0e-1b82-430e-8ee4-74732b7aa1e6"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:56.119310 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:56.125878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.126374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.126834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:56.127536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.127991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.128410 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:56.152541 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:57:56.505532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b04f134b-144b-485a-8222-8f06609fc948 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393642 Sep 08 19:57:56.506150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 256/542] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:57:56 2022] POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:56.621676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:56.622928 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:56.631297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.632148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.633340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:56.634058 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.635043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.635473 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:56.777315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:56.785907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b4a24b92-187f-484f-8d12-cf94a15d0f81 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.169566 Sep 08 19:57:56.786483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 287/543] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:56 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:56.849849 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:56.850518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:56.858578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.859673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.860174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:56.860887 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.861337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.862122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:56.985105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:56.985734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:56.997222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:56.997819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:56.998766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:57.002310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:57.004851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:57.005366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:57.009579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:57.030968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a39b44a6-3701-442e-abe8-0732461ed96f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.176308 Sep 08 19:57:57.030968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 257/544] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:56 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:57.169809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:57.177964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8d48f295-0497-4666-a484-58bfefbdc634 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.196668 Sep 08 19:57:57.178500 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 288/545] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:56 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:57.809808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:57.810342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:57.817248 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:57.817743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:57.818188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:57.818928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:57.819356 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:57.819783 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:57.955925 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:57.964628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1a42655c-d931-4df7-a9e0-596a59ed36d6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.158800 Sep 08 19:57:57.965331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 258/546] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:57 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:57:58.042719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:58.043971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:58.050218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.050784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.051472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:58.052549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.053054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.053698 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:58.066895 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-5eeac6d0-b73a-43d3-98cd-e078eec6dd09 req-6d38d9f3-e2ae-413a-b183-006c5f41aff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5070d059-02b2-46a5-84d5-020a048682fe", "name": "network-vif-plugged", "status": "completed", "tag": "50c1ecbf-f38a-4fc2-a354-d8665899070b"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:57:58.078526 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5eeac6d0-b73a-43d3-98cd-e078eec6dd09 req-6d38d9f3-e2ae-413a-b183-006c5f41aff8 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.079326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5eeac6d0-b73a-43d3-98cd-e078eec6dd09 req-6d38d9f3-e2ae-413a-b183-006c5f41aff8 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.081259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5eeac6d0-b73a-43d3-98cd-e078eec6dd09 req-6d38d9f3-e2ae-413a-b183-006c5f41aff8 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:58.093268 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-5eeac6d0-b73a-43d3-98cd-e078eec6dd09 req-6d38d9f3-e2ae-413a-b183-006c5f41aff8 service nova] Creating event network-vif-plugged:50c1ecbf-f38a-4fc2-a354-d8665899070b for instance 5070d059-02b2-46a5-84d5-020a048682fe on hv-cinder-83124 Sep 08 19:57:58.098615 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-5eeac6d0-b73a-43d3-98cd-e078eec6dd09 req-6d38d9f3-e2ae-413a-b183-006c5f41aff8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040109 Sep 08 19:57:58.100280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 259/547] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:57:58.202041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:58.203317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:58.205020 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:58.210098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.210589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.211075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:58.211822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.212444 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.212925 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:58.213721 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-87f1f47a-a25e-48ed-a8a8-983a8b48466f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1370 microversion: 2.1 time: 0.175099 Sep 08 19:57:58.214444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 289/548] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:58 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:58.349686 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:58.357436 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-26f53167-327f-4a5b-aa8a-951bd8a811ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.159655 Sep 08 19:57:58.358000 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 260/549] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:58 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:58.988838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:58.989552 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:58.995865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.996345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.996776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:58.997463 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:58.997911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:58.998333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.129841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:59.138322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4916cff5-a314-4c1e-8317-d6f70aca28cb tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.153925 Sep 08 19:57:59.138938 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 290/550] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:58 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:59.236789 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:59.237402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:59.243461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:59.243936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:59.244367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.245040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:59.245481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:59.245905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.380344 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:59.380823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:59.380955 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:59.387525 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:59.388225 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:59.388826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.389530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:59.390120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2d26004f-b8ea-474b-8d24-ec60a553773c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1565 microversion: 2.1 time: 0.157556 Sep 08 19:57:59.390350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:59.390724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 261/551] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:59 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:57:59.391145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.413349 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:57:59.413711 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:57:59.420728 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:59.421141 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:59.421743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.422441 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:57:59.422909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:57:59.423323 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:57:59.514315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-eefae575-577b-4eeb-a44c-2c648350279b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105068 Sep 08 19:57:59.515276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 262/552] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 19:57:59 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:57:59.574978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:57:59.583804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0f260f68-bd30-434c-87e3-1e37686f451a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.207267 Sep 08 19:57:59.584388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 291/553] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:57:59 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:00.161582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:00.162294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:00.169964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:00.171223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:00.173046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:00.173046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:00.173046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:00.173905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:00.607879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:00.608625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:00.616285 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:00.626952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:00.626952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:00.626952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:00.626952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:00.627321 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:00.650086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:00.663388 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f0fdf89e-32d5-4d4e-9bb0-b184b0699ee3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.505433 Sep 08 19:58:00.665084 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 263/554] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:00 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:00.828973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:00.837282 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-00edaf45-dfc9-47d0-a193-6d4993b91797 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1367 microversion: 2.1 time: 0.233549 Sep 08 19:58:00.838392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 292/555] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:00 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:00.858967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-8009de43-a8ef-4a37-ab86-2c4b7e1e0a9e req-58ab35f4-4e00-4ac3-958b-36e106dd367c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcbbdca-e7b1-4512-a75e-486b36e13cf8", "tag": "f28431b5-807d-4361-995f-3aac58e76ed9"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:00.869743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-8009de43-a8ef-4a37-ab86-2c4b7e1e0a9e req-58ab35f4-4e00-4ac3-958b-36e106dd367c service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:00.870361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-8009de43-a8ef-4a37-ab86-2c4b7e1e0a9e req-58ab35f4-4e00-4ac3-958b-36e106dd367c service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:00.870911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-8009de43-a8ef-4a37-ab86-2c4b7e1e0a9e req-58ab35f4-4e00-4ac3-958b-36e106dd367c service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:00.884654 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-8009de43-a8ef-4a37-ab86-2c4b7e1e0a9e req-58ab35f4-4e00-4ac3-958b-36e106dd367c service nova] Creating event network-changed:f28431b5-807d-4361-995f-3aac58e76ed9 for instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 on hv-cinder-83124 Sep 08 19:58:00.889749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-8009de43-a8ef-4a37-ab86-2c4b7e1e0a9e req-58ab35f4-4e00-4ac3-958b-36e106dd367c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036961 Sep 08 19:58:00.890891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 264/556] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:58:01.687141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:01.687898 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:01.698482 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:01.699020 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:01.699493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:01.700208 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:01.700665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:01.701094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:01.865413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:01.866119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:01.885658 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:01.886162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:01.886820 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:01.887739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:01.902540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:01.903023 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:01.951079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:01.959928 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-09b8ac2a-cb43-466d-bee9-05709ce504a9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1723 microversion: 2.1 time: 0.276855 Sep 08 19:58:01.970974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 293/557] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:01 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:01.981489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1853673623", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "networks": [{"uuid": "c15a05c4-ee3a-40b0-acf4-c7c192747f92"}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:02.054804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] validate_networks() for [('c15a05c4-ee3a-40b0-acf4-c7c192747f92', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:58:02.080098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:02.088402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1dd0e1fe-cdf3-44eb-8db3-cd4b941851c3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1556 microversion: 2.1 time: 0.227902 Sep 08 19:58:02.089082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 265/558] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:01 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1556 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:02.112412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:02.112902 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:02.119189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:02.119662 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:02.120122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:02.120789 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:02.121257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:02.121677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:02.203408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2976c79f-e87b-4a81-a9f0-bb5ee7840471 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094763 Sep 08 19:58:02.204083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 266/559] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 19:58:02 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:58:02.483270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:58:02.483895 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:58:02.484400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:58:02.484775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:58:02.485483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:58:02.496406 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:02.497179 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:02.497587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:02.498488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:02.499347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:02.499769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:02.508434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:02.520322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Getting quotas for project db8d755487ee442e90f0410313cb0808. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:58:02.525068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Getting quotas for user 9cf9df1891f0453dbed9d4a1c351a104 and project db8d755487ee442e90f0410313cb0808. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:58:02.537461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:58:02.539908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:58:02.551365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:02.593667 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4bb80d51-4ec7-4030-8e98-58ffd9c3d46e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620983 Sep 08 19:58:02.600265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 294/560] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:58:02.605919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fe70127a-cbf7-45ba-b3bc-72371b0ec309 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:02.606629 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fe70127a-cbf7-45ba-b3bc-72371b0ec309 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:02.693645 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fe70127a-cbf7-45ba-b3bc-72371b0ec309 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:02.701270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fe70127a-cbf7-45ba-b3bc-72371b0ec309 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1219 microversion: 2.1 time: 0.099613 Sep 08 19:58:02.702304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 267/561] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:02 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:02.987525 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:02.989401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:02.996469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:02.997050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:02.997843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:02.999380 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:02.999922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.000435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.133099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:03.141500 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c313d71d-086a-4482-ab03-5764ae022ed3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1700 microversion: 2.1 time: 0.158492 Sep 08 19:58:03.142069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 295/562] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:02 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:03.164447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a3ea37c1-ff1c-462b-8f78-c96f424792a0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:03.170802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3ea37c1-ff1c-462b-8f78-c96f424792a0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:03.171284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3ea37c1-ff1c-462b-8f78-c96f424792a0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.171706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3ea37c1-ff1c-462b-8f78-c96f424792a0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.229334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-15626bee-f4a9-4d39-b41e-1a620a58167b req-685296d9-022b-47c9-9b34-fd5642319838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5070d059-02b2-46a5-84d5-020a048682fe", "tag": "50c1ecbf-f38a-4fc2-a354-d8665899070b"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:03.236202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a3ea37c1-ff1c-462b-8f78-c96f424792a0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Going to try to start instance {{(pid=120485) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 19:58:03.239245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-15626bee-f4a9-4d39-b41e-1a620a58167b req-685296d9-022b-47c9-9b34-fd5642319838 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:03.239963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-15626bee-f4a9-4d39-b41e-1a620a58167b req-685296d9-022b-47c9-9b34-fd5642319838 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.240451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-15626bee-f4a9-4d39-b41e-1a620a58167b req-685296d9-022b-47c9-9b34-fd5642319838 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.252309 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-15626bee-f4a9-4d39-b41e-1a620a58167b req-685296d9-022b-47c9-9b34-fd5642319838 service nova] Creating event network-changed:50c1ecbf-f38a-4fc2-a354-d8665899070b for instance 5070d059-02b2-46a5-84d5-020a048682fe on hv-cinder-83124 Sep 08 19:58:03.257705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-15626bee-f4a9-4d39-b41e-1a620a58167b req-685296d9-022b-47c9-9b34-fd5642319838 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Sep 08 19:58:03.258599 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 296/563] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:58:03.282633 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a3ea37c1-ff1c-462b-8f78-c96f424792a0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action" status: 202 len: 0 microversion: 2.1 time: 0.121933 Sep 08 19:58:03.283247 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 268/564] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 19:58:03 2022] POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 19:58:03.291787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:03.292623 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:03.299553 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:03.300039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.300467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.301152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:03.301615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.302053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.439238 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:03.447998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-07f2f706-a0b4-4158-9798-60a068aeecaf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1709 microversion: 2.1 time: 0.160351 Sep 08 19:58:03.448590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 297/565] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:03 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:03.725601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:03.726779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:03.734495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:03.735463 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.736293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.737617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:03.738416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:03.739283 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:03.808454 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:03.816847 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-65936d66-1a01-42a5-a428-bd2545349ba3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1215 microversion: 2.1 time: 0.096234 Sep 08 19:58:03.817414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 269/566] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:03 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:04.470498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:04.471333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:04.483923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:04.484663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:04.485574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:04.486479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:04.487256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:04.487672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:04.696512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:04.704963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9174cb7d-edb7-48a3-9fe4-2fe9e1c1c993 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1709 microversion: 2.1 time: 0.238311 Sep 08 19:58:04.711725 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 298/567] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:04 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:04.839517 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:04.840017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:04.842001 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:04.847911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:04.848405 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:04.848833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:04.849514 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:04.849946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:04.850358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:04.916902 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:04.927344 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d75c6e28-d152-4501-af91-d9db0eeb62a3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1271 microversion: 2.1 time: 0.091487 Sep 08 19:58:04.928067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 270/568] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:04 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:05.236439 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:05.237056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:05.243925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:05.244425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:05.244856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:05.245553 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:05.246015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:05.246440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:05.388931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:05.399912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8f364f56-c5e6-4c84-9b8a-955d2200a5cf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1594 microversion: 2.1 time: 0.167340 Sep 08 19:58:05.400501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 299/569] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:05 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:05.728777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:05.729552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:05.736065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:05.736689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:05.737249 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:05.738060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:05.739651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:05.740212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:05.957009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:05.957612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:05.963994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:05.964479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:05.965122 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:05.965809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:05.966412 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:05.967033 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:05.997394 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:06.007437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-734c703b-e6bc-4860-924e-43070ba38cc4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1709 microversion: 2.1 time: 0.282610 Sep 08 19:58:06.008025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 271/570] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:05 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1709 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:06.061961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:06.071520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-34879925-6fb1-40ac-bc76-679facca46cf tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1277 microversion: 2.1 time: 0.118435 Sep 08 19:58:06.087108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 300/571] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:05 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:07.030828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:07.031453 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:07.038918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:07.039423 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:07.039858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:07.041152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:07.041617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:07.042033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:07.094420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:07.095106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:07.101612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:07.102377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:07.103019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:07.103742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:07.104196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:07.104810 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:07.307649 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:07.318528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-166d9a88-0696-4948-9d24-fa6d3f1328a1 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.227735 Sep 08 19:58:07.319490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 301/572] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:07 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:58:07.342314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:07.353160 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cd188b92-0e17-44c6-9335-e50b87063340 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1713 microversion: 2.1 time: 0.326792 Sep 08 19:58:07.353734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 272/573] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:07 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1713 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:07.409050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-5bd01142-d55a-4e45-9619-1c5383a3676c req-198e5c71-de60-47ea-8ab0-10e16b229715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5cd18c-f49a-4160-9a2f-37aaddfee406", "tag": "713110ec-e04d-4c8b-b1a4-84cee6c73183"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:07.434605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-5bd01142-d55a-4e45-9619-1c5383a3676c req-198e5c71-de60-47ea-8ab0-10e16b229715 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:07.435116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-5bd01142-d55a-4e45-9619-1c5383a3676c req-198e5c71-de60-47ea-8ab0-10e16b229715 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:07.435620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-5bd01142-d55a-4e45-9619-1c5383a3676c req-198e5c71-de60-47ea-8ab0-10e16b229715 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:07.449308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-5bd01142-d55a-4e45-9619-1c5383a3676c req-198e5c71-de60-47ea-8ab0-10e16b229715 service nova] Creating event network-changed:713110ec-e04d-4c8b-b1a4-84cee6c73183 for instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 on hv-cinder-83124 Sep 08 19:58:07.454283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-5bd01142-d55a-4e45-9619-1c5383a3676c req-198e5c71-de60-47ea-8ab0-10e16b229715 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049408 Sep 08 19:58:07.455257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 302/574] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:58:07.908713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-7ce23af9-c823-4713-9e0b-2c812a294df2 req-5e2c8853-c91a-483d-bf3e-b35ebe9c597e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:07.923706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7ce23af9-c823-4713-9e0b-2c812a294df2 req-5e2c8853-c91a-483d-bf3e-b35ebe9c597e service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:07.924339 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7ce23af9-c823-4713-9e0b-2c812a294df2 req-5e2c8853-c91a-483d-bf3e-b35ebe9c597e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:07.925131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7ce23af9-c823-4713-9e0b-2c812a294df2 req-5e2c8853-c91a-483d-bf3e-b35ebe9c597e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:07.939920 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-7ce23af9-c823-4713-9e0b-2c812a294df2 req-5e2c8853-c91a-483d-bf3e-b35ebe9c597e service nova] Creating event network-changed:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 19:58:07.945640 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-7ce23af9-c823-4713-9e0b-2c812a294df2 req-5e2c8853-c91a-483d-bf3e-b35ebe9c597e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042240 Sep 08 19:58:07.946817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 273/575] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:58:08.343390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:08.344723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:08.351732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:08.352407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:08.352875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:08.353614 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:08.354067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:08.354488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:08.526279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:08.534260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cce5093f-7491-4489-b816-42e04c78a20b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.196374 Sep 08 19:58:08.534864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 303/576] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:08 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:08.994987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-642056270"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:08.995621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:09.003036 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.003564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.003998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.004698 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.005154 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.005576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.019124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:09.137291 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.network.security_group_api [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Adding security group 494b3023-b741-4cfa-af90-7a8ffce144f6 to port fffdab31-cb2a-4dae-9e01-98ae0d68568d Sep 08 19:58:09.475911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-186ddcf8-bf43-43e5-90e5-e339e83febc9 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/action" status: 202 len: 0 microversion: 2.1 time: 0.485914 Sep 08 19:58:09.476725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 274/577] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 19:58:08 2022] POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 19:58:09.485157 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:09.485693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:09.491909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.492402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.492834 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.493530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.493984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.494404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.557864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:09.558814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:09.560780 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=100 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:09.566098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.566819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.567254 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.567956 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.568573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.568993 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.643928 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:09.652677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-81722c2d-0b0f-4bd7-a03f-29483398eb42 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1640 microversion: 2.1 time: 0.171471 Sep 08 19:58:09.653259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 304/578] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:09 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1640 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:09.708351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:09.717326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-72010cf8-398e-45d5-b3c8-5102c7ca57eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.163948 Sep 08 19:58:09.717895 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 275/579] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:09 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:58:09.960827 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-e406f321-e69a-448c-9350-3f082bc869fe req-cb65a37c-884d-4ac2-b5f7-7bc75f6c1e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:09.970782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-e406f321-e69a-448c-9350-3f082bc869fe req-cb65a37c-884d-4ac2-b5f7-7bc75f6c1e7b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:09.971262 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-e406f321-e69a-448c-9350-3f082bc869fe req-cb65a37c-884d-4ac2-b5f7-7bc75f6c1e7b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:09.971688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-e406f321-e69a-448c-9350-3f082bc869fe req-cb65a37c-884d-4ac2-b5f7-7bc75f6c1e7b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:09.983460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-e406f321-e69a-448c-9350-3f082bc869fe req-cb65a37c-884d-4ac2-b5f7-7bc75f6c1e7b service nova] Creating event network-changed:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 19:58:09.988374 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-e406f321-e69a-448c-9350-3f082bc869fe req-cb65a37c-884d-4ac2-b5f7-7bc75f6c1e7b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031281 Sep 08 19:58:09.989005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 305/580] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:58:10.744660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:10.745214 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:10.752406 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:10.752893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:10.753327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:10.754021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:10.754486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:10.754947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:10.887591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:10.895793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-99f0e2ef-1bbe-43cb-9466-07615fe827b2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.156538 Sep 08 19:58:10.896367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 276/581] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:10 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:11.920360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:11.921068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:11.927716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:11.928206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:11.928639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:11.929329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:11.929814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:11.930237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:12.066084 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:12.074066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2ea165d1-464f-4346-8068-2341ce51fdd4 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.158116 Sep 08 19:58:12.074632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 306/582] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:11 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:13.096932 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:13.097549 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:13.099913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:13.105889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:13.106367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:13.106830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:13.107518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:13.107972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:13.108391 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:13.246368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:13.254592 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-60133213-f24d-4634-9a1f-2bbd129d8cdd tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.161727 Sep 08 19:58:13.255189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 277/583] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:13 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:14.281941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:14.283013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:14.286141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:14.287459 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=6 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:14.296940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:14.297790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:14.298533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:14.299775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:14.300594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:14.301293 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:14.436256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:14.444141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a88451d1-8196-40c4-980c-12e88ac0d72d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.168869 Sep 08 19:58:14.444715 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 307/584] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:14 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:14.535927 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-8ba74ea1-32f6-4754-b32f-1ed6beb5e719 req-2c6a081d-5ebc-45e3-85c3-2e60f55867d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5cd18c-f49a-4160-9a2f-37aaddfee406", "name": "network-vif-plugged", "status": "completed", "tag": "713110ec-e04d-4c8b-b1a4-84cee6c73183"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:14.546719 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-8ba74ea1-32f6-4754-b32f-1ed6beb5e719 req-2c6a081d-5ebc-45e3-85c3-2e60f55867d9 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:14.547207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-8ba74ea1-32f6-4754-b32f-1ed6beb5e719 req-2c6a081d-5ebc-45e3-85c3-2e60f55867d9 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:14.547638 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-8ba74ea1-32f6-4754-b32f-1ed6beb5e719 req-2c6a081d-5ebc-45e3-85c3-2e60f55867d9 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:14.559548 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-8ba74ea1-32f6-4754-b32f-1ed6beb5e719 req-2c6a081d-5ebc-45e3-85c3-2e60f55867d9 service nova] Creating event network-vif-plugged:713110ec-e04d-4c8b-b1a4-84cee6c73183 for instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 on hv-cinder-83124 Sep 08 19:58:14.564596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-8ba74ea1-32f6-4754-b32f-1ed6beb5e719 req-2c6a081d-5ebc-45e3-85c3-2e60f55867d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032553 Sep 08 19:58:14.565143 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 278/585] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:58:15.470250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:15.471307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:15.479879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:15.480367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:15.480800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:15.481498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:15.481951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:15.482377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:15.612668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:15.620777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b5ff0be2-8291-4ab8-b566-5d17d7981672 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.157081 Sep 08 19:58:15.621329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 308/586] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:15 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:16.650179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:16.651311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:16.659339 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:16.659831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:16.660256 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:16.661027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:16.661450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:16.662063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:16.803108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:16.812195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-973597fb-6a1a-45cf-89ea-dd02a2f4ed00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.170770 Sep 08 19:58:16.812766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 279/587] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:16 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:17.839021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:17.840065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:17.850245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:17.851101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:17.851821 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:17.852949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:17.853609 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:17.854028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:17.992095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:18.000631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1272adf6-406f-422f-bd91-15d618732f5a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1319 microversion: 2.1 time: 0.168049 Sep 08 19:58:18.001129 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 309/588] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:17 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:19.026796 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:58:19.027407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:19.034441 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:19.034935 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:19.035414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:19.036206 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:19.036665 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:19.037095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:19.181921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:58:19.193594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-934f0334-1549-4c49-904b-6bbd97c6867f tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1507 microversion: 2.1 time: 0.172148 Sep 08 19:58:19.194361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 280/589] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:58:19 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:58:46.342848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c65a1e49-90f7-4422-81cc-cc485cfcda3a", "device": "/dev/sdb"}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:58:46.345779 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:58:46.348040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=30 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:46.349043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=79 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:58:46.355136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:46.355625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:46.356063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:46.356751 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:58:46.357181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:58:46.357601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:58:46.745920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-63473378-6acf-4949-ad0e-f9f0e3c42e3c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "POST /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406912 Sep 08 19:58:46.746732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 310/590] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:58:46 2022] POST /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:59:14.869820 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:14.870307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:14.872741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=11 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:14.873749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=33 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:14.881315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:14.881800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:14.882234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:14.882959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:14.883426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:14.883826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:15.057568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lazy-loading 'services' on Instance uuid cf5cd18c-f49a-4160-9a2f-37aaddfee406 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 19:59:15.184427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e238369e-e747-43d6-907b-dd03e7784948 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406/os-volume_attachments/c65a1e49-90f7-4422-81cc-cc485cfcda3a" status: 202 len: 0 microversion: 2.1 time: 0.318653 Sep 08 19:59:15.185029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 281/591] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 19:59:14 2022] DELETE /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406/os-volume_attachments/c65a1e49-90f7-4422-81cc-cc485cfcda3a => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 19:59:16.314625 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:16.315209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:16.317804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:16.318668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:16.327586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:16.328063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:16.328492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:16.329177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:16.329622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:16.330039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:16.356194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 19:59:16.437855 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c19650be-d0d5-4330-b01a-b54ccf63ecf2 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 204 len: 0 microversion: 2.1 time: 0.127256 Sep 08 19:59:16.438469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 311/592] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 19:59:16 2022] DELETE /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 19:59:16.449882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:16.450743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:16.457361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:16.457862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:16.458265 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:16.458987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:16.459432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:16.459847 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:16.592463 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:16.600624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-111bdc90-0e89-46f1-9f76-e07a831d068e tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1513 microversion: 2.1 time: 0.156792 Sep 08 19:59:16.601191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 282/593] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:16 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:17.637460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:17.638204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:17.645306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:17.645846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:17.646322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:17.647126 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:17.647626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:17.648094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:17.785265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:17.793492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2100dcd8-c18c-43f3-b3af-502ce1351c08 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1513 microversion: 2.1 time: 0.163283 Sep 08 19:59:17.794076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 312/594] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:17 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:18.819475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:18.820208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:18.827381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:18.827868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:18.828299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:18.829040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:18.829491 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:18.829920 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:19.047419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:19.055557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2989a9ea-9d60-407f-a4da-4b0100109f1a tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 200 len: 1513 microversion: 2.1 time: 0.242678 Sep 08 19:59:19.056137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 283/595] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:18 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:19.366045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-a3931e72-5770-4ec7-8930-f32044a9c2d2 req-8eaafce9-4e49-4f84-bf5c-5c537ebb6525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5cd18c-f49a-4160-9a2f-37aaddfee406", "name": "network-vif-deleted", "tag": "713110ec-e04d-4c8b-b1a4-84cee6c73183"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:59:19.375958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a3931e72-5770-4ec7-8930-f32044a9c2d2 req-8eaafce9-4e49-4f84-bf5c-5c537ebb6525 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:19.376441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a3931e72-5770-4ec7-8930-f32044a9c2d2 req-8eaafce9-4e49-4f84-bf5c-5c537ebb6525 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:19.376849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a3931e72-5770-4ec7-8930-f32044a9c2d2 req-8eaafce9-4e49-4f84-bf5c-5c537ebb6525 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:19.388379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-a3931e72-5770-4ec7-8930-f32044a9c2d2 req-8eaafce9-4e49-4f84-bf5c-5c537ebb6525 service nova] Creating event network-vif-deleted:713110ec-e04d-4c8b-b1a4-84cee6c73183 for instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 on hv-cinder-83124 Sep 08 19:59:19.393230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-a3931e72-5770-4ec7-8930-f32044a9c2d2 req-8eaafce9-4e49-4f84-bf5c-5c537ebb6525 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091675 Sep 08 19:59:19.393825 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 313/596] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:59:20.078999 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:20.079646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: cf5cd18c-f49a-4160-9a2f-37aaddfee406] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:20.086897 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:20.087383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:20.087820 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:20.088630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:20.089127 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:20.089550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:20.103114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] HTTP exception thrown: Instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 could not be found. Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Request method failure captured: Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 HTTP/1.1 Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGklIWjTlq4fhLhmLV4ZxJnMePO_Ny92XAfSpp415NZsDXDIAhDuzzy3UoIQNFkGor6j-yC0AyOc6kVWY5vEvXs2o_Tb1sv2Xgh_Te8qFD4PXoPgZvo7_jGK_9lT3ijxJVurLMYUOQxRy9q5ywLA0F_Qtu6bj_frGz8_bUOOEc8riQys Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: db8d755487ee442e90f0410313cb0808 Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-VolumesSnapshotTestJSON-881622718 Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 19:59:20.104768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db8d755487ee442e90f0410313cb0808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_db8d755487ee442e90f0410313cb0808", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db8d755487ee442e90f0410313cb0808"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/db8d755487ee442e90f0410313cb0808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-VolumesSnapshotTestJSON-881622718 Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: db8d755487ee442e90f0410313cb0808 Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-881622718 Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-VolumesSnapshotTestJSON-881622718-project Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 9cf9df1891f0453dbed9d4a1c351a104 Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-VolumesSnapshotTestJSON-881622718-project Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 could not be found. Sep 08 19:59:20.106431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'cf5cd18c-f49a-4160-9a2f-37aaddfee406'} Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 could not be found. Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 19:59:20.107479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 could not be found. Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 could not be found. Sep 08 19:59:20.108985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 19:59:20.110468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Returning 404 to user: Instance cf5cd18c-f49a-4160-9a2f-37aaddfee406 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 19:59:20.110468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c4b09c3b-c435-4e5c-9519-e6e494ac1171 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406" status: 404 len: 111 microversion: 2.1 time: 0.031396 Sep 08 19:59:20.110468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 284/597] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:20 2022] GET /compute/v2.1/servers/cf5cd18c-f49a-4160-9a2f-37aaddfee406 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 19:59:32.187590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:32.188757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:32.192978 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-869166449", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "networks": [{"uuid": "c15a05c4-ee3a-40b0-acf4-c7c192747f92"}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:59:32.245614 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] validate_networks() for [('c15a05c4-ee3a-40b0-acf4-c7c192747f92', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 19:59:32.651897 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 19:59:32.652325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 19:59:32.652797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 19:59:32.653254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 19:59:32.653696 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 19:59:32.663394 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:32.663878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:32.664316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:32.665047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:32.665543 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:32.665967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:32.683509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Getting quotas for project db8d755487ee442e90f0410313cb0808. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 19:59:32.687938 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Getting quotas for user 9cf9df1891f0453dbed9d4a1c351a104 and project db8d755487ee442e90f0410313cb0808. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 19:59:32.700247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 19:59:32.702874 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 19:59:32.752076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e8dcc347-aa4a-4b9a-af02-1066a7dc7c8c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566041 Sep 08 19:59:32.752731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 314/598] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 19:59:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 19:59:32.764845 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fd124ed0-5eb5-4c0e-9b86-6483d31cc029 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:32.765559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fd124ed0-5eb5-4c0e-9b86-6483d31cc029 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:32.768675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=8 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:32.769555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:32.828137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fd124ed0-5eb5-4c0e-9b86-6483d31cc029 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:32.836344 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fd124ed0-5eb5-4c0e-9b86-6483d31cc029 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1218 microversion: 2.1 time: 0.075600 Sep 08 19:59:32.836899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 285/599] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:32 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 19:59:33.862828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:33.863644 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:33.874454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:33.874991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:33.875392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:33.876079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:33.876527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:33.876942 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:33.940078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:33.952554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-98ce8508-59b3-4c37-beb4-789ab8c69b91 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1270 microversion: 2.1 time: 0.096206 Sep 08 19:59:33.953353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 315/600] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:33 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:34.981327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:34.981945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:34.989345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:34.989839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:34.990273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:34.991025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:34.991482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:34.991903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:35.370991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:35.379328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3b77b443-4e15-49ac-a64d-46b7509f581d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.401937 Sep 08 19:59:35.379882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 286/601] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:34 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:35.787306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-6462799e-f32d-484d-b9b3-db691070f171 req-00b94d02-ca0a-4821-ad71-e44a362f0a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e9ea828-1b8e-478e-83f4-e612ce28b8e4", "tag": "20cb472d-3c3a-478e-a3ce-b3afd4ce4a24"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:59:35.800291 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6462799e-f32d-484d-b9b3-db691070f171 req-00b94d02-ca0a-4821-ad71-e44a362f0a92 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:35.800853 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6462799e-f32d-484d-b9b3-db691070f171 req-00b94d02-ca0a-4821-ad71-e44a362f0a92 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:35.801282 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6462799e-f32d-484d-b9b3-db691070f171 req-00b94d02-ca0a-4821-ad71-e44a362f0a92 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:35.813221 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-6462799e-f32d-484d-b9b3-db691070f171 req-00b94d02-ca0a-4821-ad71-e44a362f0a92 service nova] Creating event network-changed:20cb472d-3c3a-478e-a3ce-b3afd4ce4a24 for instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 on hv-cinder-83124 Sep 08 19:59:35.818628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-6462799e-f32d-484d-b9b3-db691070f171 req-00b94d02-ca0a-4821-ad71-e44a362f0a92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035151 Sep 08 19:59:35.819567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 316/602] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 19:59:36.403035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:36.403730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:36.411687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:36.412252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:36.412759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:36.413564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:36.414088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:36.414578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:36.547238 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:36.555681 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ff4cfacb-f3cd-4848-8fb8-96f7792423e6 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.157411 Sep 08 19:59:36.556245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 287/603] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:36 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:37.580078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:37.580746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:37.587726 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:37.588224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:37.588665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:37.589381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:37.589841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:37.590271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:37.728066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:37.738420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a7959191-9249-471f-aa79-4d77fd4b9970 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.163362 Sep 08 19:59:37.739017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 317/604] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:37 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:38.763739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:38.764538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:38.772118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:38.772598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:38.773028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:38.773716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:38.774165 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:38.774582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:38.917135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:38.929583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f875884d-e4f7-4955-bba1-bc2b75572842 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.170774 Sep 08 19:59:38.930371 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 288/605] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:38 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:39.953570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:39.954193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:39.962791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:39.963450 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:39.964089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:39.965200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:39.965859 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:39.966483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:40.107303 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:40.115731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8035cb54-3cff-4ff6-85a4-882b28feafe9 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.166037 Sep 08 19:59:40.116307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 318/606] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:39 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:41.139251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:41.139859 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:41.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:41.150020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:41.150518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:41.151620 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:41.152137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:41.152721 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:41.292767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:41.304835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-563ff968-13f1-46f4-bf88-1d98303f4c73 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.169242 Sep 08 19:59:41.305675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 289/607] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:41 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:42.334480 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:42.335529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:42.346485 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:42.347367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:42.348095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:42.349244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:42.350005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:42.350744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:42.486379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:42.494454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2b736c6d-8335-4f01-a945-50c3a8f614f7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.166719 Sep 08 19:59:42.495063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 319/608] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:42 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:43.067694 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-3ef76a6c-60ec-4573-a078-db3deed2cc11 req-5ae701b1-7075-49de-b26c-0faeb26d1b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9ea828-1b8e-478e-83f4-e612ce28b8e4", "name": "network-vif-plugged", "status": "completed", "tag": "20cb472d-3c3a-478e-a3ce-b3afd4ce4a24"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:59:43.073741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:43.079890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-3ef76a6c-60ec-4573-a078-db3deed2cc11 req-5ae701b1-7075-49de-b26c-0faeb26d1b30 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:43.080413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-3ef76a6c-60ec-4573-a078-db3deed2cc11 req-5ae701b1-7075-49de-b26c-0faeb26d1b30 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:43.080867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-3ef76a6c-60ec-4573-a078-db3deed2cc11 req-5ae701b1-7075-49de-b26c-0faeb26d1b30 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:43.092624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-3ef76a6c-60ec-4573-a078-db3deed2cc11 req-5ae701b1-7075-49de-b26c-0faeb26d1b30 service nova] Creating event network-vif-plugged:20cb472d-3c3a-478e-a3ce-b3afd4ce4a24 for instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 on hv-cinder-83124 Sep 08 19:59:43.097581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-3ef76a6c-60ec-4573-a078-db3deed2cc11 req-5ae701b1-7075-49de-b26c-0faeb26d1b30 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033676 Sep 08 19:59:43.098172 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 290/609] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 19:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 19:59:43.521541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:43.522491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:43.525631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:43.526719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=6 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 19:59:43.535160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:43.535627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:43.536231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:43.536907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:43.537355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:43.537772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:43.678028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:43.689228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-91201675-67ca-46c1-a6e2-9e3bb991f8eb tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.174247 Sep 08 19:59:43.689771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 320/610] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:43 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:44.713281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:44.713988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:44.720316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:44.720809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:44.721248 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:44.721943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:44.722396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:44.722845 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:44.860184 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:44.868480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cf77f4a6-7df8-4b36-9252-e1b6da59dfd7 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1318 microversion: 2.1 time: 0.160131 Sep 08 19:59:44.869047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 291/611] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:44 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:45.896104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 19:59:45.897136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:45.908040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:45.908523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:45.908953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:45.909646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:45.910091 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:45.910509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:46.047765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 19:59:46.055878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9af67bef-c9f1-42a3-9d78-1080e8fe764b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1506 microversion: 2.1 time: 0.166435 Sep 08 19:59:46.056448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 321/612] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 19:59:45 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 19:59:46.078118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3432a81d-38ad-4a2b-809c-b5741e8f4823", "device": "/dev/sdb"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 19:59:46.081129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 19:59:46.087839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:46.088319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:46.088834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:46.089519 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 19:59:46.089970 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 19:59:46.090382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 19:59:46.344216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b1188e20-5293-47cb-817f-8775fbdaf26c tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "POST /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269957 Sep 08 19:59:46.345044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 292/613] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 19:59:46 2022] POST /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:07.697447 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:07.698603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=40 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:07.808259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:07.808751 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:07.815034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:07.815523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:07.815954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:07.816637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:07.817090 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:07.817513 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:07.949223 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lazy-loading 'services' on Instance uuid c22bff83-6076-4522-87b8-762a5ee75a3f {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:08.065265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-92a45899-7711-4de5-ba16-34a53015d7c6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-volume_attachments/df227177-7c7d-4930-976f-00a6e27ce1f6" status: 202 len: 0 microversion: 2.1 time: 0.375738 Sep 08 20:00:08.065955 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 322/614] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:00:07 2022] DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-volume_attachments/df227177-7c7d-4930-976f-00a6e27ce1f6 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:08.979896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:08.980689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:08.983292 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=18 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:08.983995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:08.991033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:08.992621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:08.992621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:08.992876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:08.993114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:08.993588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:09.083975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lazy-loading 'services' on Instance uuid 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:09.162156 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a0b64984-ead1-41c8-8624-5caf2a37c06d tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4/os-volume_attachments/3432a81d-38ad-4a2b-809c-b5741e8f4823" status: 202 len: 0 microversion: 2.1 time: 0.187295 Sep 08 20:00:09.162819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 293/615] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:00:08 2022] DELETE /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4/os-volume_attachments/3432a81d-38ad-4a2b-809c-b5741e8f4823 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:09.201472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5e9da669-d56e-4f78-a8eb-646d41a388c5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:09.208774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e9da669-d56e-4f78-a8eb-646d41a388c5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:09.209850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e9da669-d56e-4f78-a8eb-646d41a388c5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:09.210311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5e9da669-d56e-4f78-a8eb-646d41a388c5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:09.235162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5e9da669-d56e-4f78-a8eb-646d41a388c5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Going to try to stop instance {{(pid=120484) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 20:00:09.278425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5e9da669-d56e-4f78-a8eb-646d41a388c5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action" status: 202 len: 0 microversion: 2.1 time: 0.086378 Sep 08 20:00:09.279018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 323/616] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:00:09 2022] POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:09.287871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:09.288585 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:09.295235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:09.295718 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:09.296146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:09.296833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:09.297285 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:09.297700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:09.441361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:09.449721 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-070e667c-5e78-4b5f-afbc-05b93a9e82a6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.166080 Sep 08 20:00:09.450513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 294/617] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:09 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:10.289692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:10.290337 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:10.296513 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:10.296994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:10.297423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:10.298106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:10.298550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:10.299005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:10.324330 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:00:10.399165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0e2f8ed7-905e-4b1e-bc56-3685bd530a5b tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 204 len: 0 microversion: 2.1 time: 0.113909 Sep 08 20:00:10.399847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 324/618] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:00:10 2022] DELETE /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:00:10.408103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:10.408765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:10.415413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:10.415896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:10.416331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:10.417021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:10.417484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:10.417904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:10.473658 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:10.474352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:10.480632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:10.481118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:10.481546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:10.482222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:10.482692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:10.483133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:10.553130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:10.561031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-15de0224-eafa-4320-8606-f79495173a00 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1512 microversion: 2.1 time: 0.156726 Sep 08 20:00:10.561660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 295/619] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:10 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:10.614795 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:10.623207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-579d33d3-4b24-4b77-8ad8-4f32f9d45f80 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.153300 Sep 08 20:00:10.623786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 325/620] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:10 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:11.588428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:11.589361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:11.600425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:11.601234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:11.601957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:11.603162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:11.603905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:11.604659 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:11.645786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:11.646476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:11.653131 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:11.653679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:11.654242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:11.655048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:11.655604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:11.656133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:11.736908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:11.744806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1cefce97-dbfb-48e5-ab3a-0c2b44a031c5 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1512 microversion: 2.1 time: 0.162988 Sep 08 20:00:11.745424 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 296/621] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:11 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:11.786286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:11.794349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a90e369e-fa3e-466f-845f-690c520a92b8 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.152741 Sep 08 20:00:11.795301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 326/622] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:11 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:12.768087 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:12.768652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:12.775170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:12.775653 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:12.776081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:12.776776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:12.777228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:12.777740 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:12.817445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:12.818013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:12.825775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:12.825775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:12.825983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:12.826671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:12.827141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:12.827532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:12.956529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:12.964693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0c083022-0676-47d2-95e6-9d2cb35a902c tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.151062 Sep 08 20:00:12.965362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 327/623] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:12 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:12.975972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf9df1891f0453dbed9d4a1c351a104', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db8d755487ee442e90f0410313cb0808', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:12.984605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-84a4d77b-ff68-4cdd-b993-547f5224b352 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 200 len: 1512 microversion: 2.1 time: 0.220469 Sep 08 20:00:12.985166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 297/624] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:12 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:13.124663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-2d570970-36a6-4d09-90fe-5b158e06713a req-96b829ed-275c-423f-aa16-9c2d52faec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e9ea828-1b8e-478e-83f4-e612ce28b8e4", "name": "network-vif-deleted", "tag": "20cb472d-3c3a-478e-a3ce-b3afd4ce4a24"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:13.136223 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-2d570970-36a6-4d09-90fe-5b158e06713a req-96b829ed-275c-423f-aa16-9c2d52faec2d service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:13.136803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-2d570970-36a6-4d09-90fe-5b158e06713a req-96b829ed-275c-423f-aa16-9c2d52faec2d service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:13.137230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-2d570970-36a6-4d09-90fe-5b158e06713a req-96b829ed-275c-423f-aa16-9c2d52faec2d service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:13.148817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-2d570970-36a6-4d09-90fe-5b158e06713a req-96b829ed-275c-423f-aa16-9c2d52faec2d service nova] Creating event network-vif-deleted:20cb472d-3c3a-478e-a3ce-b3afd4ce4a24 for instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 on hv-cinder-83124 Sep 08 20:00:13.154205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-2d570970-36a6-4d09-90fe-5b158e06713a req-96b829ed-275c-423f-aa16-9c2d52faec2d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033635 Sep 08 20:00:13.154823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 328/625] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:13.988042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:13.988616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:13.995621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:13.996128 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:13.996564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:13.997259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:13.998072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:13.998497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:14.008937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:14.009733 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] [instance: 7e9ea828-1b8e-478e-83f4-e612ce28b8e4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:14.016378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:14.016869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:14.017294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:14.017993 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:14.018442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:14.018893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:14.032499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] HTTP exception thrown: Instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 could not be found. Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Request method failure captured: Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 HTTP/1.1 Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGklIWjTlq4fhLhmLV4ZxJnMePO_Ny92XAfSpp415NZsDXDIAhDuzzy3UoIQNFkGor6j-yC0AyOc6kVWY5vEvXs2o_Tb1sv2Xgh_Te8qFD4PXoPgZvo7_jGK_9lT3ijxJVurLMYUOQxRy9q5ywLA0F_Qtu6bj_frGz8_bUOOEc8riQys Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: db8d755487ee442e90f0410313cb0808 Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-VolumesSnapshotTestJSON-881622718 Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:00:14.034141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db8d755487ee442e90f0410313cb0808"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_db8d755487ee442e90f0410313cb0808", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/db8d755487ee442e90f0410313cb0808"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/db8d755487ee442e90f0410313cb0808"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-VolumesSnapshotTestJSON-881622718 Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: db8d755487ee442e90f0410313cb0808 Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-881622718 Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-VolumesSnapshotTestJSON-881622718-project Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 9cf9df1891f0453dbed9d4a1c351a104 Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-VolumesSnapshotTestJSON-881622718-project Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 could not be found. Sep 08 20:00:14.035635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '7e9ea828-1b8e-478e-83f4-e612ce28b8e4'} Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 could not be found. Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:00:14.036401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 could not be found. Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 could not be found. Sep 08 20:00:14.037619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:00:14.039046 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] Returning 404 to user: Instance 7e9ea828-1b8e-478e-83f4-e612ce28b8e4 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:00:14.039046 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-444ae890-2bd7-471f-b62c-75d062523ed3 tempest-VolumesSnapshotTestJSON-881622718 tempest-VolumesSnapshotTestJSON-881622718-project] 10.222.0.44 "GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4" status: 404 len: 111 microversion: 2.1 time: 0.031413 Sep 08 20:00:14.039385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 329/626] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:14 2022] GET /compute/v2.1/servers/7e9ea828-1b8e-478e-83f4-e612ce28b8e4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:00:14.132955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:14.141140 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-17789ef8-495d-4aa9-97bb-1eb3ee8e0ebf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.157073 Sep 08 20:00:14.141728 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 298/627] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:13 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:15.166308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:15.167028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:15.176677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:15.177476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:15.178200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:15.179408 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:15.180162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:15.180872 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:15.322784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:15.331081 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cc1ff444-8a63-4bd1-a815-fe8f15cfe054 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.169887 Sep 08 20:00:15.331612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 330/628] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:15 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:16.357422 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:16.358782 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:16.369329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:16.370133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:16.370898 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:16.372039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:16.373187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:16.373885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:16.501917 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:16.509763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-675e5352-edc7-464f-bb9e-e7a1ba13d887 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.158893 Sep 08 20:00:16.510345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 299/629] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:16 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:17.532834 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:17.533533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:17.539940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:17.540422 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:17.540853 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:17.541535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:17.541984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:17.542403 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:17.677605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:17.689329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-89a0002b-e75e-42d9-a813-a320b01ee147 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.160289 Sep 08 20:00:17.690159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 331/630] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:17 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:18.721057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:18.721596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:18.728507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:18.728997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:18.729426 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:18.730116 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:18.730573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:18.731031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:18.863406 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:18.871447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bcaaff9b-4c4e-4c96-955a-fb8a44c7a479 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.156026 Sep 08 20:00:18.872016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 300/631] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:18 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:19.129544 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:19.133176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:19.143279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:19.143767 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:19.144198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:19.144886 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:19.145332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:19.145731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:19.227657 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-897ef081-4260-4ea7-8fc9-59fa3d9ab326 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/action" status: 202 len: 0 microversion: 2.1 time: 0.106960 Sep 08 20:00:19.228369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 332/632] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:00:19 2022] POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:19.238555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:19.239199 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:19.245684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:19.246172 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:19.246701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:19.247812 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:19.248252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:19.248671 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:19.404219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:19.413088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d100404b-0ef7-4bfb-b1bf-d0cec588e96a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1751 microversion: 2.1 time: 0.178498 Sep 08 20:00:19.413632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 301/633] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:19 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:19.897799 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:19.898899 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:19.908657 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:19.909414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:19.910077 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:19.911189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:19.911893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:19.912550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:20.057271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:20.065419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-088d91e8-f314-4077-abe0-8325d0ff7bbd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.174209 Sep 08 20:00:20.065988 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 333/634] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:19 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:20.437658 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:20.438288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:20.445146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:20.445643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:20.446076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:20.446808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:20.447262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:20.447678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:20.707169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:20.715959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-362fdc95-f366-415f-90e3-0c5ac0813cf5 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1751 microversion: 2.1 time: 0.282323 Sep 08 20:00:20.716764 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 302/635] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:20 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1751 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:21.088593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:21.089267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:21.095911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:21.096448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:21.096934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:21.097810 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:21.098267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:21.098766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:21.237069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:21.245286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c66b50c6-c13d-4638-b7d0-0ffef9ee97dd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.160468 Sep 08 20:00:21.245867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 334/636] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:21 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:21.739466 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:21.740033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:21.746997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:21.747856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:21.748298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:21.748990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:21.749442 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:21.749866 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:21.900067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:21.908527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-82cfe8b9-8e2b-4220-81a1-c38ba3a20c6d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.173032 Sep 08 20:00:21.909070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 303/637] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:21 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:22.269197 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:22.269790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:22.276623 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:22.277114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:22.277552 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:22.278329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:22.278816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:22.279244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:22.297784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:22.416683 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:22.424956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9b12a7eb-cd8e-4b97-9a9e-427fc88bc69f tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.159709 Sep 08 20:00:22.425536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 335/638] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:22 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:22.939560 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:22.940520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:22.951244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:22.952044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:22.952755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:22.953890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:22.954689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:22.955130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:23.095207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:23.103596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fc0dad72-4308-4457-991b-75a6e7189cc8 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.170730 Sep 08 20:00:23.104142 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 304/639] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:22 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:23.456206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:23.456847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:23.463835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:23.464353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:23.464788 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:23.465488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:23.465936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:23.466364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:23.601974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:23.612184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ece8b590-f1e7-48be-9912-59986a894fdc tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.162586 Sep 08 20:00:23.612854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 336/640] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:23 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:24.130624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:24.131361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:24.140194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:24.140843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:24.141412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:24.142325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:24.142964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:24.143519 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:24.299674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:24.308438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-aa7d47df-8420-4567-a144-61a31f631247 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.183715 Sep 08 20:00:24.309016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 305/641] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:24 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:24.640092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:24.641037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:24.652085 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:24.652900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:24.653626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:24.654777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:24.655578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:24.656286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:24.786427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:24.808236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c81863bd-2ddc-4edd-972e-fc7d246780b9 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1677 microversion: 2.1 time: 0.170629 Sep 08 20:00:24.808236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 337/642] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:24 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:25.333625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:25.334545 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:25.342463 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:25.343215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:25.343850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:25.344897 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:25.345702 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:25.346335 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:25.497072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:25.506275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1ffc4899-3e33-4450-8fe2-e44b678eb408 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.178386 Sep 08 20:00:25.506853 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 306/643] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:25 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:25.829530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:25.830141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:25.836916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:25.837407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:25.837849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:25.838548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:25.839034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:25.839460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:25.984007 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:25.992250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ac85cb68-1e5a-453e-bddd-d904f6ccd8fd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1654 microversion: 2.1 time: 0.167417 Sep 08 20:00:25.992984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 338/644] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:25 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1654 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:26.015293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-547bb2e5-87b9-40e8-9635-cb647224f6aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:26.021621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-547bb2e5-87b9-40e8-9635-cb647224f6aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:26.022115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-547bb2e5-87b9-40e8-9635-cb647224f6aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:26.022555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-547bb2e5-87b9-40e8-9635-cb647224f6aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:26.045647 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-547bb2e5-87b9-40e8-9635-cb647224f6aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Going to try to start instance {{(pid=120485) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 20:00:26.078988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:26.089561 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-547bb2e5-87b9-40e8-9635-cb647224f6aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action" status: 202 len: 0 microversion: 2.1 time: 0.078017 Sep 08 20:00:26.090159 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 307/645] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:00:26 2022] POST /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:26.100060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:26.100670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:26.107006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:26.107496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:26.107935 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:26.108626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:26.109083 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:26.109506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:26.242158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:26.252814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9117ca9b-2166-4c73-b55c-5b6234e5e4f0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1663 microversion: 2.1 time: 0.156590 Sep 08 20:00:26.253378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 339/646] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:26 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:26.535666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:26.536859 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:26.547178 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:26.547971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:26.548689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:26.549815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:26.550689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:26.551139 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:26.711104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:26.722903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c9863b4c-7089-44cb-8ca3-ab8b3bb382be tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.195316 Sep 08 20:00:26.723779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 308/647] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:26 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:27.279829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:27.280678 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:27.291496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:27.292294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:27.293009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:27.294133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:27.294942 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:27.295640 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:27.429101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:27.437279 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-afa0ca59-9f84-46cb-8ae5-83d686cd7bcd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1663 microversion: 2.1 time: 0.163987 Sep 08 20:00:27.438074 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 340/648] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:27 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:27.753563 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:27.754180 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:27.761063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:27.761552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:27.761987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:27.762672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:27.763162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:27.763584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:27.912773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:27.921508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c7dedb9f-66eb-408c-a757-514cca18ecf3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.172772 Sep 08 20:00:27.922051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 309/649] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:27 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:28.465079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:28.466117 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:28.475560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:28.476058 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:28.476496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:28.477202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:28.477656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:28.478080 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:28.615370 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:28.623787 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1ff66748-f3e8-453c-89c8-329cac72e95a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1663 microversion: 2.1 time: 0.165557 Sep 08 20:00:28.624402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 341/650] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:28 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:28.949313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:28.950333 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:28.959686 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:28.960168 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:28.960594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:28.961284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:28.961734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:28.962149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:29.112089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:29.120890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6a26cd5f-8b6a-4dd8-9e4e-094aef08474d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.178285 Sep 08 20:00:29.121459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 310/651] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:28 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:29.647299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:29.647907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:29.654911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:29.655398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:29.655833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:29.656527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:29.656982 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:29.657405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:29.788763 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:29.796671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fcf355c5-619e-41d1-9dac-a5083e8d52bd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1663 microversion: 2.1 time: 0.153468 Sep 08 20:00:29.797253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 342/652] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:29 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:30.147014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:30.147620 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:30.154676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:30.155196 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:30.155633 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:30.156330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:30.156804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:30.157207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:30.314262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:30.325205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e62a63c3-24e1-44f4-81fc-b18f5ebb543a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.183253 Sep 08 20:00:30.325893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 311/653] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:30 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:30.820490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:30.823048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:30.829813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:30.830304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:30.830766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:30.831467 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:30.831923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:30.832345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:30.968871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:30.979793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2c3e3b28-7da3-44a0-b6f6-1c5bae577a0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1667 microversion: 2.1 time: 0.163932 Sep 08 20:00:30.980532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 343/654] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:30 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:31.353119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:31.353989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:31.366751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:31.367789 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:31.368850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:31.369993 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:31.370736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:31.371452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:31.537688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:31.546668 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cec8e202-0de1-4ad2-ad68-9d07cca783f3 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.200355 Sep 08 20:00:31.547281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 312/655] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:31 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:32.573776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:32.575109 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:32.584685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:32.585173 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:32.585614 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:32.586315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:32.586813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:32.587236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:32.738215 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:32.746822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6398e6bb-80dd-499b-ae91-9ec5f7add69d tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.179451 Sep 08 20:00:32.747770 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 344/656] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:32 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:33.652142 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ee2cf66-8c2b-4889-83cb-627afc1c9dd4"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:33.654618 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:33.661957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:33.662428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:33.662917 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:33.663649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:33.664075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:33.664500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:33.770384 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:33.771032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:33.777889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:33.778377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:33.778882 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:33.779554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:33.780011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:33.780431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:33.929741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9de10214-0270-48d0-91d3-2629dd3eb963 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281536 Sep 08 20:00:33.930562 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 313/657] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:00:33 2022] POST /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:33.934845 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:33.944312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-35a24628-e7c4-4636-9a7a-fb895557a68e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.177817 Sep 08 20:00:33.944893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 345/658] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:33 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:00:34.972596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:34.973735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:34.981345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:34.981733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:34.982158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:34.982886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:34.983436 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:34.983844 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.143617 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:35.153313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6e99dca1-1df1-46ed-8e2e-df1c13ca427e tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.187769 Sep 08 20:00:35.154083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 314/659] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:34 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:35.249126 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:35.249622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:35.258002 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.258488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.258993 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.259653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.260108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.260533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.283756 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-84f7cb59-3580-45d7-9109-f62a1d79a3b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/ips" status: 200 len: 148 microversion: 2.1 time: 0.148772 Sep 08 20:00:35.284302 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 346/660] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 20:00:35 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/ips => generated 148 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:35.299238 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "febc7e17-b626-4319-be39-111765e7c9d5"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:35.303007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:35.312046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.312707 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.313302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.314314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.314959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.315373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.397573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Invalid volume: volume febc7e17-b626-4319-be39-111765e7c9d5 is already attached to instances: 6f740383-c694-46e4-adea-1b308e00014e Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: POST /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/os-volume_attachments HTTP/1.1 Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 74 Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:00:35.399412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {"volumeAttachment": {"volumeId": "febc7e17-b626-4319-be39-111765e7c9d5"}} Sep 08 20:00:35.400967 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Invalid volume: volume febc7e17-b626-4319-be39-111765e7c9d5 is already attached to instances: 6f740383-c694-46e4-adea-1b308e00014e Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'server_id': '5070d059-02b2-46a5-84d5-020a048682fe', 'body': {'volumeAttachment': {'volumeId': 'febc7e17-b626-4319-be39-111765e7c9d5'}}} Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume febc7e17-b626-4319-be39-111765e7c9d5 is already attached to instances: 6f740383-c694-46e4-adea-1b308e00014e Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:35.402019 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume febc7e17-b626-4319-be39-111765e7c9d5 is already attached to instances: 6f740383-c694-46e4-adea-1b308e00014e Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:35.403476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume febc7e17-b626-4319-be39-111765e7c9d5 is already attached to instances: 6f740383-c694-46e4-adea-1b308e00014e Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 400 to user: Invalid volume: volume febc7e17-b626-4319-be39-111765e7c9d5 is already attached to instances: 6f740383-c694-46e4-adea-1b308e00014e {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2c34010b-264a-4bbb-b477-6e6107d06e90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108282 Sep 08 20:00:35.405015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 315/661] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:00:35 2022] POST /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:00:35.412300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:35.413113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:35.422555 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.423268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.423709 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.424672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.425445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.426096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.451589 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:00:35.534449 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4bcbffcc-d2ff-4bb8-b385-8de965fcdd3a tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 204 len: 0 microversion: 2.1 time: 0.128022 Sep 08 20:00:35.535004 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 347/662] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:00:35 2022] DELETE /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:00:35.543816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:35.544424 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:35.551399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.551947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.552383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.553114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:35.553569 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:35.553992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:35.694822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:35.703036 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ae7a739a-5a2c-4a08-8648-8474131845f2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1680 microversion: 2.1 time: 0.163020 Sep 08 20:00:35.703636 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 316/663] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:35 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:36.177744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:36.178423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:36.185302 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:36.185784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:36.186194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:36.186917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:36.187360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:36.187788 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:36.336921 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:36.345339 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8a499901-60f0-4155-a9dd-42edbc77585f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.171842 Sep 08 20:00:36.345914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 348/664] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:36 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:36.730532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:36.731182 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:36.738480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:36.739025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:36.739486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:36.740230 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:36.740715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:36.741163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:36.878245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:36.890189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a17cbebd-f1fb-4e14-924d-171f6cebf2bf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1680 microversion: 2.1 time: 0.163515 Sep 08 20:00:36.891042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 317/665] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:36 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:37.369301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:37.369893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:37.377270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:37.378102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:37.378734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:37.379632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:37.380233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:37.380913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:37.568606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:37.578425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9425069d-0b6f-4eca-8eb8-16c8db3c270c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1756 microversion: 2.1 time: 0.212930 Sep 08 20:00:37.579061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 349/666] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:37 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:37.916244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:37.916847 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:37.923612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:37.924106 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:37.924538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:37.925226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:37.925674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:37.926093 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:38.132525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:38.140471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4b0c54db-f3f6-46ea-9709-f44c02ea5552 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1680 microversion: 2.1 time: 0.228233 Sep 08 20:00:38.141054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 318/667] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:37 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1680 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:38.536316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-d54509ce-254c-4884-a690-24d0fca7d12a req-b5633cf4-07d6-4cab-9f9b-8cd07dbef9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5070d059-02b2-46a5-84d5-020a048682fe", "name": "network-vif-deleted", "tag": "50c1ecbf-f38a-4fc2-a354-d8665899070b"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:38.544526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:38.553586 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d54509ce-254c-4884-a690-24d0fca7d12a req-b5633cf4-07d6-4cab-9f9b-8cd07dbef9c8 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:38.554336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d54509ce-254c-4884-a690-24d0fca7d12a req-b5633cf4-07d6-4cab-9f9b-8cd07dbef9c8 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:38.556516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d54509ce-254c-4884-a690-24d0fca7d12a req-b5633cf4-07d6-4cab-9f9b-8cd07dbef9c8 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:38.572542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-d54509ce-254c-4884-a690-24d0fca7d12a req-b5633cf4-07d6-4cab-9f9b-8cd07dbef9c8 service nova] Creating event network-vif-deleted:50c1ecbf-f38a-4fc2-a354-d8665899070b for instance 5070d059-02b2-46a5-84d5-020a048682fe on hv-cinder-83124 Sep 08 20:00:38.577413 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-d54509ce-254c-4884-a690-24d0fca7d12a req-b5633cf4-07d6-4cab-9f9b-8cd07dbef9c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045298 Sep 08 20:00:38.578389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 350/668] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:38.603979 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:38.605010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:38.611411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:38.612146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:38.612756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:38.613519 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:38.614149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:38.614848 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:38.815627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:38.826705 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-32475e9c-1899-41f4-ac3f-cbb23e88ed7c tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1759 microversion: 2.1 time: 0.225835 Sep 08 20:00:38.827164 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 319/669] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:38 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1759 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:39.164831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:39.165700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:39.174707 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:39.175212 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:39.175646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:39.176404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:39.176854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:39.177273 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:39.199173 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:39.218101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:39.218575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:39.219068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:39.219535 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lazy-loading 'fault' on Instance uuid 5070d059-02b2-46a5-84d5-020a048682fe {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:39.275734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:39.285779 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9f904be4-15b7-4bc6-9a3f-14bc63a31612 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 200 len: 1331 microversion: 2.1 time: 0.125293 Sep 08 20:00:39.286604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 351/670] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:39 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 1331 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:40.309913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:40.310540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:40.321043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=55 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:40.323711 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:40.324537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:40.325307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:40.326194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:40.326841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:40.327414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:40.344569 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe HTTP/1.1 Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:00:40.346183 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:00:40.347538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '5070d059-02b2-46a5-84d5-020a048682fe'} Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:00:40.348272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:00:40.349535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:40.351041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:00:40.351041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-21d60d65-9897-4a17-9bce-0c8bda0dc6a8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 404 len: 111 microversion: 2.1 time: 0.042348 Sep 08 20:00:40.351041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 320/671] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:40 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:00:40.359195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-65387328-ccbd-491c-8d78-69e128b979ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '.version_select at 0x7fef84c7fdc0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:40.384892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-65387328-ccbd-491c-8d78-69e128b979ce tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586047409" status: 202 len: 0 microversion: 2.1 time: 0.032061 Sep 08 20:00:40.385619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 352/672] 10.222.0.44 () {58 vars in 1221 bytes} [Thu Sep 8 20:00:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586047409 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:41.201487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:41.202214 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:41.209858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.211289 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.211796 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.212614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.213069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.213515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.331219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lazy-loading 'services' on Instance uuid 6f740383-c694-46e4-adea-1b308e00014e {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:41.424940 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-aa9cdc7e-5dd4-4cd5-a999-204d793d5d24 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments/febc7e17-b626-4319-be39-111765e7c9d5" status: 202 len: 0 microversion: 2.1 time: 0.227396 Sep 08 20:00:41.426299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 321/673] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:00:41 2022] DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments/febc7e17-b626-4319-be39-111765e7c9d5 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:41.451316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:41.453654 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:41.462932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.463780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.464366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.465256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.465883 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.466459 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.508581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-16504e01-4bf4-4c2c-8389-ce4487e994f9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076311 Sep 08 20:00:41.510757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 353/674] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:00:41 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:41.578564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:41.582103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:41.588915 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.589593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.590028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.590775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.591288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.591713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.614507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lazy-loading 'flavor' on Instance uuid 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:41.628962 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:41.749186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3877fdb2-042a-47ba-8a82-71aa278d0403 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/action" status: 200 len: 32 microversion: 2.1 time: 0.175076 Sep 08 20:00:41.749854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 322/675] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:00:41 2022] POST /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 20:00:41.759420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:41.760040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:41.765973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.766452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.767034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.767589 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:41.770300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:41.771103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:41.902878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:41.913414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e297065e-0167-4e3e-bd12-a59de1009844 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.157820 Sep 08 20:00:41.914102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 354/676] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:41 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:42.521815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:42.524203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:42.530732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.531212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.531658 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.532379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.532815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.533228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.563131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-133c8279-3e8d-4475-802a-bfece186000c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046121 Sep 08 20:00:42.563675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 323/677] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:00:42 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:00:42.630105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:42.630618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:42.637985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.638468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.638939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.639635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.640088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.640510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.668503 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:00:42.752094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8bd7897e-d30e-41ce-aea4-b4d8b945c3bb tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 204 len: 0 microversion: 2.1 time: 0.125542 Sep 08 20:00:42.752682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 355/678] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:00:42 2022] DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:00:42.762556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:42.763316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:42.769542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.770026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.770445 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.771211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.771696 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.772364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.903567 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:42.911284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0e469578-c829-4d96-b846-eaa3758b671c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1681 microversion: 2.1 time: 0.153881 Sep 08 20:00:42.911852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 324/679] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:42 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:00:42.940271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:42.942178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:42.951382 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.952094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.952754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:42.953807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:42.954514 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:42.955181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:43.085306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:43.093945 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9f9303f3-bc4a-4655-9c6e-6bac15ce9c1c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.160519 Sep 08 20:00:43.094523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 356/680] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:42 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:43.939504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:43.940581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:43.948910 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:43.949388 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:43.949845 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:43.950657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:43.951200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:43.951686 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:44.086465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:44.094616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-98680c80-ce19-45e8-8af6-c5b4e8bbc9cf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1681 microversion: 2.1 time: 0.162116 Sep 08 20:00:44.095210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 325/681] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:43 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:44.116831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:44.117580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:44.124807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:44.125291 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:44.125723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:44.126434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:44.126916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:44.127335 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:44.255914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:44.264498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0c26f3aa-77da-494a-b966-313cd125b6fb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.151512 Sep 08 20:00:44.265071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 357/682] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:44 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:45.122730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:45.123555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:45.134477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:45.135341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:45.136069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:45.137208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:45.137978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:45.138819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:45.270368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:45.278815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5b6e54e1-71be-4b8b-ade1-4d80eb5cf746 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1681 microversion: 2.1 time: 0.163121 Sep 08 20:00:45.279381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 326/683] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:45 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:45.287595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:45.288231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:45.295446 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:45.296194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:45.296829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:45.297859 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:45.298469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:45.299062 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:45.429345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:45.438630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-107eb996-6799-4be9-ba8e-cbb9f91862f9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.154549 Sep 08 20:00:45.438849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 358/684] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:45 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:46.301513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:46.302095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:46.308980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:46.309580 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:46.310100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:46.310934 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:46.311560 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:46.312111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:46.328365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-21642d25-4a4c-4d2f-8a4d-b23e75621533 req-45cf40d5-0ada-494b-9011-7c15d2905891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f740383-c694-46e4-adea-1b308e00014e", "name": "network-vif-deleted", "tag": "f448e2c8-6562-498b-8c79-0c3b9eded991"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:46.343161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-21642d25-4a4c-4d2f-8a4d-b23e75621533 req-45cf40d5-0ada-494b-9011-7c15d2905891 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:46.344066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-21642d25-4a4c-4d2f-8a4d-b23e75621533 req-45cf40d5-0ada-494b-9011-7c15d2905891 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:46.344574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-21642d25-4a4c-4d2f-8a4d-b23e75621533 req-45cf40d5-0ada-494b-9011-7c15d2905891 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:46.356576 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-21642d25-4a4c-4d2f-8a4d-b23e75621533 req-45cf40d5-0ada-494b-9011-7c15d2905891 service nova] Creating event network-vif-deleted:f448e2c8-6562-498b-8c79-0c3b9eded991 for instance 6f740383-c694-46e4-adea-1b308e00014e on hv-cinder-83124 Sep 08 20:00:46.363356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-21642d25-4a4c-4d2f-8a4d-b23e75621533 req-45cf40d5-0ada-494b-9011-7c15d2905891 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039035 Sep 08 20:00:46.364078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 359/685] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:46.388717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:46.396590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c96814ec-1a47-4ff2-a9c0-0401d11a7bda tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1614 microversion: 2.1 time: 0.098929 Sep 08 20:00:46.397168 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 327/686] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:46 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:46.460975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:46.461725 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:46.486097 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:46.487066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:46.489684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:46.490670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:46.492067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:46.494730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:46.643588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:46.652431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1649b876-6308-4a8c-8933-7669c7296629 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.195692 Sep 08 20:00:46.653010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 360/687] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:46 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:47.419827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:47.420416 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:47.427403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:47.427886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:47.428322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:47.429015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:47.429471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:47.429893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:47.491564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:47.500380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-24a927a0-291f-4da7-886a-9f299e21b164 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1326 microversion: 2.1 time: 0.084534 Sep 08 20:00:47.500943 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 328/688] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:47 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:47.676005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:47.676538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:47.683375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:47.683856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:47.684313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:47.684974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:47.685420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:47.685844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:47.817664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:47.826011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8b564ca4-eeba-477f-b2dc-0b22681d5628 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.154069 Sep 08 20:00:47.826572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 361/689] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:47 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:48.527388 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:48.528367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:48.539342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:48.540135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:48.540860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:48.542058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:48.542533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:48.542977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:48.577205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:48.577205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:48.577205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:48.577205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lazy-loading 'fault' on Instance uuid 6f740383-c694-46e4-adea-1b308e00014e {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:48.619574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:48.627859 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9bb11922-df7b-4a8d-8946-adfa61a33412 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 200 len: 1331 microversion: 2.1 time: 0.106933 Sep 08 20:00:48.628417 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 329/690] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:48 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 1331 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:48.852519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:48.853418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:48.863085 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:48.863764 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:48.864400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:48.865418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:48.866099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:48.866703 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:49.001018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:49.009643 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9813d9a2-75d9-457c-b1a8-37cd74bdd43c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.162916 Sep 08 20:00:49.010224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 362/691] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:48 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:49.657732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:49.658769 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:49.669681 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:49.670497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:49.671272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:49.672395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:49.673202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:49.673912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:49.691383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e HTTP/1.1 Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:00:49.693054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:00:49.694496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '6f740383-c694-46e4-adea-1b308e00014e'} Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:00:49.695372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:00:49.696836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:00:49.698219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:00:49.698219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e77cd3ef-5e75-4eb2-8bb1-15267ac4c14b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 404 len: 111 microversion: 2.1 time: 0.043401 Sep 08 20:00:49.698219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 330/692] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:49 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:00:49.703455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4eb5f455-07cf-44ac-b44d-c239e1a5f9b8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '.version_select at 0x7fef84deb820>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:49.727595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4eb5f455-07cf-44ac-b44d-c239e1a5f9b8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554176980" status: 202 len: 0 microversion: 2.1 time: 0.027999 Sep 08 20:00:49.728192 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 363/693] 10.222.0.44 () {58 vars in 1218 bytes} [Thu Sep 8 20:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554176980 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:50.032792 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:50.033408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:50.040220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:50.040730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:50.041169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:50.041872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:50.042353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:50.042986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:50.180305 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:50.189366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f61bfc11-a124-4b2d-b804-aab9da699b9f tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.160756 Sep 08 20:00:50.189928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 331/694] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:50 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:50.404389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5f67b9ca-3bb6-43d9-ae4e-9bbeb7b8ad51 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: .version_select at 0x7fef84c7ea60>, body: {"keypair": {"name": "tempest-keypair-28852618", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+VeVECqMfKiposSroLDtHgm+CmM/p8LpQhC/FhOVbz/AYCyLqR0bO9PbvA0F2I1uAYCvK3eGgJA5k+pKKdZ09VNsxFgoSxLSnp2g7rBNPPHp00IwlTWtiuBZN1ynE/eQ=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:50.421485 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-5f67b9ca-3bb6-43d9-ae4e-9bbeb7b8ad51 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:00:50.425563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-5f67b9ca-3bb6-43d9-ae4e-9bbeb7b8ad51 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:00:50.451286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5f67b9ca-3bb6-43d9-ae4e-9bbeb7b8ad51 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053014 Sep 08 20:00:50.451892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 364/695] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 20:00:50 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:00:51.213380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:51.214612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:51.222239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:51.223040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:51.223662 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:51.224694 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:51.225199 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:51.225811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:51.463239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:51.475435 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a4551a9b-6fc5-46ad-9230-a4f1001e6573 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.266104 Sep 08 20:00:51.476036 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 332/696] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:51 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:51.839888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-80093492", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e992bb3-3c6d-436c-8011-0fb47db3a78e"}], "security_groups": [{"name": "tempest-securitygroup--494351349"}], "key_name": "tempest-keypair-28852618", "user_data": "}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:51.944219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] validate_networks() for [('9e992bb3-3c6d-436c-8011-0fb47db3a78e', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:00:52.322812 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:00:52.323268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:00:52.323734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:00:52.324179 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:00:52.324574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:00:52.333833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:52.334308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:52.334775 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:52.335498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:52.335944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:52.336359 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:52.353018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:00:52.357350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:00:52.369280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:00:52.371636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:00:52.421943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-92e35327-ba21-4789-99cb-07cfc6f25593 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.587174 Sep 08 20:00:52.422597 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 365/697] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 20:00:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 20:00:52.435871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e545a195-95d6-42cd-b291-a85bc64128e5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:52.437136 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e545a195-95d6-42cd-b291-a85bc64128e5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:52.495934 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e545a195-95d6-42cd-b291-a85bc64128e5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:52.498605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:52.499245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:52.503889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e545a195-95d6-42cd-b291-a85bc64128e5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1238 microversion: 2.1 time: 0.073446 Sep 08 20:00:52.504712 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 333/698] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:52 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:52.506714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:52.507281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:52.507722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:52.508426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:52.508907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:52.509332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:52.643185 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:52.651508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6b21ca92-2711-4e24-a334-da63140f51fe tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.157222 Sep 08 20:00:52.652321 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 366/699] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:52 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:00:53.531292 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:53.532173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:53.544596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:53.545399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:53.546163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:53.547343 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:53.548111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:53.549305 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:53.626419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:53.634520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3f36debe-c306-4829-bbbb-a3c00e3b7508 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1290 microversion: 2.1 time: 0.109986 Sep 08 20:00:53.635202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 334/700] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:53 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:53.675010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:53.675803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:53.683647 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:53.684140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:53.684990 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:53.685698 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:53.686147 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:53.686566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:53.835361 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:53.845322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4fc6d6a7-4777-4f4e-a4bc-fb48fbdff1b9 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.174418 Sep 08 20:00:53.846087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 367/701] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:53 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:54.142085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:54.142677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:54.149092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.149588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.150017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.150746 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.151215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.151604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.176279 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lazy-loading 'flavor' on Instance uuid fe38b93c-1307-4796-b320-67b6b3465e9d {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:00:54.255775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-eb3de425-9d41-4d8a-87d3-34d2892c7425 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "POST /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d/action" status: 202 len: 0 microversion: 2.1 time: 0.117483 Sep 08 20:00:54.256407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 335/702] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:00:54 2022] POST /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:00:54.264710 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:54.265317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:54.271620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.272064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.272520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.273489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.273934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.274659 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.410903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:54.419431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-959fc43b-28f6-4617-a29b-dc7c430e8408 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.158585 Sep 08 20:00:54.420018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 368/703] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:54 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:54.658533 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:54.659276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:54.666735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.667709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.668340 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.669307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.669768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.670184 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.869193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:54.870869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:54.878469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.879693 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:00:54.879693 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:00:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 (ip 10.222.0.44) !!! Sep 08 20:00:54.881834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:00:54.882018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:00:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 (ip 10.222.0.44) !!! Sep 08 20:00:54.889212 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.892393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.894545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:54.897944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:54.898616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:54.899271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:54.914871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f39d80e7-0827-4a2a-98ce-aa888face97e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.261021 Sep 08 20:00:54.915536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 336/704] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:54 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:55.031968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:55.041436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-07cce80f-e893-49ba-b8c6-069ee2b55f3c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.176131 Sep 08 20:00:55.042220 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 369/705] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:54 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:00:55.420667 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-e0294f36-7547-47eb-b134-ff601e2e57cd req-3b023c69-c838-452c-8feb-92a8cb519b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e3493f-fd10-45d6-bc85-4456db192b87", "tag": "a85c575e-ffe4-4267-baa8-6666a568dd35"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:00:55.432285 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-e0294f36-7547-47eb-b134-ff601e2e57cd req-3b023c69-c838-452c-8feb-92a8cb519b33 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:55.432981 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-e0294f36-7547-47eb-b134-ff601e2e57cd req-3b023c69-c838-452c-8feb-92a8cb519b33 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:55.433720 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-e0294f36-7547-47eb-b134-ff601e2e57cd req-3b023c69-c838-452c-8feb-92a8cb519b33 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:55.443755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:55.444680 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:55.452601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:55.456463 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:55.456965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:55.457400 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:55.458118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:55.465699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:55.466168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:55.470187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-e0294f36-7547-47eb-b134-ff601e2e57cd req-3b023c69-c838-452c-8feb-92a8cb519b33 service nova] Creating event network-changed:a85c575e-ffe4-4267-baa8-6666a568dd35 for instance 36e3493f-fd10-45d6-bc85-4456db192b87 on hv-cinder-83124 Sep 08 20:00:55.476359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-e0294f36-7547-47eb-b134-ff601e2e57cd req-3b023c69-c838-452c-8feb-92a8cb519b33 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059538 Sep 08 20:00:55.477151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 337/706] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:00:55.488030 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:00:55.601648 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:55.609509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-22c9eddd-1bb0-4e08-b481-451a6a9c3d0e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.170577 Sep 08 20:00:55.610088 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 370/707] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:55 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:00:55.942901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:55.943964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:55.952530 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:55.953018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:55.953449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:55.954144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:55.954600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:55.955062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:56.064398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:56.065116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:56.071600 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:56.072091 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:56.072526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:56.073222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:56.073673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:56.074222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:56.091963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:56.100404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b52586ef-d625-4549-8a6c-f1ef01f69f43 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.164900 Sep 08 20:00:56.100983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 338/708] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:55 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:56.215849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:56.224478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4e758677-74fb-4d2b-82b7-b87caec2272d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.164130 Sep 08 20:00:56.225082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 371/709] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:56 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:56.637070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:56.637908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:56.644332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:56.644818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:56.645341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:56.646043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:56.646502 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:56.646957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:56.778528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:56.790367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-88147fbf-4e9a-4fa2-a2ab-a83fdab6aa9d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.159662 Sep 08 20:00:56.791212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 339/710] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:56 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:57.127781 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:57.128679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:57.140297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:57.141042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:57.141783 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:57.143898 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:57.143898 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:57.144393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:57.248914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:57.249505 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:57.256272 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:57.256767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:57.257201 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:57.257896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:57.258351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:57.258841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:57.285121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:57.292826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f94e4830-484e-4a5f-b466-e20080e5d267 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.172225 Sep 08 20:00:57.293387 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 372/711] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:57 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:57.394425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:57.402811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9c592368-337a-4e09-be50-52d289bb0439 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.158320 Sep 08 20:00:57.403378 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 340/712] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:57 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:57.818997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:57.820057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:57.830219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:57.831114 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:57.831850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:57.833001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:57.833762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:57.834475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:57.976736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:57.988922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ce1c3f29-7c67-40c9-8ffd-ea246e2d590b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.176155 Sep 08 20:00:57.989670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 373/713] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:57 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:58.315384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:58.315976 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:58.322838 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:58.323319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:58.323746 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:58.324428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:58.324925 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:58.325332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:58.425963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:58.426597 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:58.433259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:58.433746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:58.434295 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:58.435018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:58.435465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:58.436085 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:58.539174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:58.547889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a5acdb2c-573e-47ab-a794-f2d7f9f418ac tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.236288 Sep 08 20:00:58.548785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 341/714] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:58 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:58.569841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:58.578358 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e795213f-950d-4b79-9513-a2d4de8589d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.156864 Sep 08 20:00:58.578966 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 374/715] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:58 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:00:59.019576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:59.020672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:59.031088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:59.031897 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:59.032611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:59.033755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:59.034507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:59.035231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:59.182751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:59.191219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-75318829-5dcc-4210-ac30-63f9bc27d229 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.178240 Sep 08 20:00:59.191800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 342/716] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:59 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:59.575325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:59.575905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:59.583413 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:59.583959 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:59.584444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:59.585304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:59.585815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:59.586289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:59.602088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:00:59.603586 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:00:59.610833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:59.611317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:59.611731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:59.612452 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:00:59.612923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:00:59.613341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:00:59.722461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:59.730425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-90bb263c-7716-4ca6-8c13-98c69f19776d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.161952 Sep 08 20:00:59.734688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 375/717] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:59 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:00:59.747501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:00:59.755917 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f0921854-6458-4074-9020-c5a1efe09979 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.158212 Sep 08 20:00:59.756488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 343/718] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:00:59 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:00.218086 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:00.218765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:00.225477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:00.225971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:00.226438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:00.227198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:00.227675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:00.228121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:00.654202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:00.662441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-35034093-2e36-48cc-add9-14f21b63fa46 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.450128 Sep 08 20:01:00.663042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 376/719] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:00 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:00.753919 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:00.754555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:00.761550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:00.762038 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:00.762470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:00.763201 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:00.763653 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:00.764075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:00.779281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:00.779891 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:00.786394 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:00.786922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:00.787357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:00.788052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:00.788665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:00.789089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:00.899541 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:00.907486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-839b1833-df86-40f9-bb8d-53833943b4d4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.157495 Sep 08 20:01:00.908175 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 344/720] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:00 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:00.921456 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:00.929781 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9369d339-b4fc-4efa-831b-1c7f2f7b8858 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.154424 Sep 08 20:01:00.930372 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 377/721] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:00 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:01.466074 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-5641535a-d627-4fac-8a8f-65a5238f2d15 req-cdb9e4d2-fc62-4b7c-acc8-947a62ce1b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e3493f-fd10-45d6-bc85-4456db192b87", "name": "network-vif-plugged", "status": "completed", "tag": "a85c575e-ffe4-4267-baa8-6666a568dd35"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:01.475951 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5641535a-d627-4fac-8a8f-65a5238f2d15 req-cdb9e4d2-fc62-4b7c-acc8-947a62ce1b6b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.476366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5641535a-d627-4fac-8a8f-65a5238f2d15 req-cdb9e4d2-fc62-4b7c-acc8-947a62ce1b6b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.476785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5641535a-d627-4fac-8a8f-65a5238f2d15 req-cdb9e4d2-fc62-4b7c-acc8-947a62ce1b6b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:01.487764 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-5641535a-d627-4fac-8a8f-65a5238f2d15 req-cdb9e4d2-fc62-4b7c-acc8-947a62ce1b6b service nova] Creating event network-vif-plugged:a85c575e-ffe4-4267-baa8-6666a568dd35 for instance 36e3493f-fd10-45d6-bc85-4456db192b87 on hv-cinder-83124 Sep 08 20:01:01.492661 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-5641535a-d627-4fac-8a8f-65a5238f2d15 req-cdb9e4d2-fc62-4b7c-acc8-947a62ce1b6b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151666 Sep 08 20:01:01.493229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 345/722] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:01.686028 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:01.686679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:01.694001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.694466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.694918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:01.695687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.696140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.696554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:01.881780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:01.891832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7c667568-3c74-496b-978b-56fe9289809e tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.210074 Sep 08 20:01:01.892378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 378/723] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:01 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:01.931799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:01.932477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:01.940031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.940446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.940887 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:01.941600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.942058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.942482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:01.953338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:01.953954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:01.960354 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.960815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.961251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:01.961958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:01.962412 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:01.962905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:02.074188 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:02.082192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9817adfc-25c9-4219-b24b-3376f4c6471d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.155178 Sep 08 20:01:02.082779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 346/724] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:01 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:02.095106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:02.103414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-049bcd70-84a1-4b98-b4af-fa374867df0e tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1736 microversion: 2.1 time: 0.154145 Sep 08 20:01:02.103967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 379/725] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:01 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:02.919169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:02.920370 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:02.923506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:02.933443 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:02.934503 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:02.935192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:02.935891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:02.936353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:02.936776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.074521 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:03.086712 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8817c5e1-23c4-49c9-ba43-212e152db0b0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.173803 Sep 08 20:01:03.087576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 347/726] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:02 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:03.105234 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:03.105841 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:03.107801 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:03.108464 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=10 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:03.114410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.114944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.115379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.116072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.116518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.116954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.126971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:03.127565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:03.133477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.133963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.134390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.135111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.135579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.135999 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.252161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:03.260043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-122fe3d2-e309-4e64-9690-f37dc9f74a6f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1363 microversion: 2.1 time: 0.159036 Sep 08 20:01:03.260585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 380/727] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:03 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:03.268590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:03.276912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0fcacffc-6779-4b9c-9c06-93626895f37d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1716 microversion: 2.1 time: 0.153672 Sep 08 20:01:03.277409 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 348/728] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:03 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:01:03.387255 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:03.387782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:03.389744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:03.395319 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.395804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.396237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.396919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.397363 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.397793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.480980 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] HTTP exception thrown: Cannot 'detach_volume' instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 while it is in vm_state rescued Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Request method failure captured: Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments/2ee2cf66-8c2b-4889-83cb-627afc1c9dd4 HTTP/1.1 Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGki8d-OB0eDZ6Vkt6UGghZDoe2rkUKNqUW6RrQAoj2pXCX_uM4l3YTYgJNBXCXNPa9PrTw2ITxH4qPaSK3uqdgFCHkVqTNenktwQlSFFXyhCqUbJ-xQ214ld5YWe70ZxxMqS30CGwHbQL0h7zEh7W6EeSS_lEVvvtoj__iGRWZgYx5c Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:01:03.482730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_933256f83bff41ff986dd79bd06a6b74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 628b75f16eb14ce1b7deed61ade28b9c Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:01:03.484300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Cannot 'detach_volume' instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 while it is in vm_state rescued Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'server_id': '7bcbbdca-e7b1-4512-a75e-486b36e13cf8', 'id': '2ee2cf66-8c2b-4889-83cb-627afc1c9dd4'} Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:01:03.485048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 while it is in vm_state rescued Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 while it is in vm_state rescued Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:03.486271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Returning 409 to user: Cannot 'detach_volume' instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 while it is in vm_state rescued {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:01:03.487283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9a5c09c4-a1bc-40aa-a3de-8c131e1ef3bb tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments/2ee2cf66-8c2b-4889-83cb-627afc1c9dd4" status: 409 len: 152 microversion: 2.1 time: 0.100946 Sep 08 20:01:03.487283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 381/729] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:01:03 2022] DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments/2ee2cf66-8c2b-4889-83cb-627afc1c9dd4 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 20:01:03.493199 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:03.493725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:03.500270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.500770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.501187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.501876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.502322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.502770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.574049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-19803f18-26e1-461f-ac66-e85065d87453 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "POST /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/action" status: 202 len: 0 microversion: 2.1 time: 0.084457 Sep 08 20:01:03.574578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 349/730] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:01:03 2022] POST /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:01:03.583122 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:03.583737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:03.590452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.590954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.591388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.592048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:03.592519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:03.592932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:03.726693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:03.735502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6088a739-af8b-4d86-9d6c-955aaa4d7d55 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1724 microversion: 2.1 time: 0.156394 Sep 08 20:01:03.736073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 382/731] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:03 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:04.118407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:04.119634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:04.130567 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.131470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.132148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.133307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.134062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.134829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.272588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:04.280918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7ed4d6ec-e82a-4ed6-9315-8ac44cd816db tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.170436 Sep 08 20:01:04.281471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 350/732] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:04 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:04.283529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:04.284198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:04.290837 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.291117 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.291547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.292247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.292694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.293122 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.506269 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:04.514502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7c08460a-1c72-4563-b8da-1593516e4e47 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1552 microversion: 2.1 time: 0.234979 Sep 08 20:01:04.515112 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 383/733] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:04 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1552 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:04.537017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:04.537508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:04.543842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.544328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.544790 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.545476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.545960 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.546377 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.622797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-79064006-6e05-4e80-8b48-f9ea0ef7365f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089224 Sep 08 20:01:04.623517 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 351/734] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 20:01:04 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:04.760424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:04.761167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:04.769534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.769534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.769534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:04.769534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:04.770067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:04.770441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:05.003399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:05.012049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-561075b0-7988-435b-bd30-c16814ce4cc2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1724 microversion: 2.1 time: 0.255811 Sep 08 20:01:05.012613 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 384/735] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:04 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:05.305683 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:05.306268 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:05.312643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:05.313124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:05.313550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:05.314231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:05.314685 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:05.315129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:05.527682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:05.536400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-38f5bafd-e051-4203-b9ef-d233a144ec1f tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.235054 Sep 08 20:01:05.536974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 352/736] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:05 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:05.670104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-89fb3d9a-1151-493f-a638-50ed59be4ff4 req-0188c6d1-2048-43b3-8df2-9decb1486a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e3493f-fd10-45d6-bc85-4456db192b87", "tag": "a85c575e-ffe4-4267-baa8-6666a568dd35"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:05.680268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-89fb3d9a-1151-493f-a638-50ed59be4ff4 req-0188c6d1-2048-43b3-8df2-9decb1486a97 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:05.680747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-89fb3d9a-1151-493f-a638-50ed59be4ff4 req-0188c6d1-2048-43b3-8df2-9decb1486a97 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:05.681175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-89fb3d9a-1151-493f-a638-50ed59be4ff4 req-0188c6d1-2048-43b3-8df2-9decb1486a97 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:05.692681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-89fb3d9a-1151-493f-a638-50ed59be4ff4 req-0188c6d1-2048-43b3-8df2-9decb1486a97 service nova] Creating event network-changed:a85c575e-ffe4-4267-baa8-6666a568dd35 for instance 36e3493f-fd10-45d6-bc85-4456db192b87 on hv-cinder-83124 Sep 08 20:01:05.697772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-89fb3d9a-1151-493f-a638-50ed59be4ff4 req-0188c6d1-2048-43b3-8df2-9decb1486a97 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Sep 08 20:01:05.698357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 385/737] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:06.035771 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:06.036757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:06.043085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:06.043607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:06.044194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:06.045041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:06.045591 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:06.046239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:06.177878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:06.186470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bd846bf7-5d8e-4520-9698-af25755444a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1724 microversion: 2.1 time: 0.154555 Sep 08 20:01:06.187301 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 353/738] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:06 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:06.560889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:06.561612 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:06.568441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:06.568923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:06.569354 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:06.570072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:06.570517 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:06.570966 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:06.712057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:06.720191 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-848a84f8-3968-427c-b8ba-a50f48f99639 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.163632 Sep 08 20:01:06.720739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 386/739] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:06 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:07.214028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:07.215116 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:07.226400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:07.227233 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:07.227948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:07.229135 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:07.229892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:07.230602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:07.250292 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:07.370372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:07.379553 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-24a99e35-b218-4087-9e1e-0a86dc059c65 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1724 microversion: 2.1 time: 0.172009 Sep 08 20:01:07.380102 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 354/740] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:07 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:07.749165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:07.749599 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:07.757713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:07.758466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:07.759150 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:07.760202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:07.760879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:07.761475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:07.894948 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:07.898504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:07.903777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ab5d1b25-4376-44dd-9c0e-b70089ee6951 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.159549 Sep 08 20:01:07.904346 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 387/741] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:07 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:08.404465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:08.405157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:08.411988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:08.412477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:08.412908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:08.413601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:08.414052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:08.414470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:08.547037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:08.555544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c57d9051-c11e-4d22-bd27-2a13e5449bf5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1730 microversion: 2.1 time: 0.155076 Sep 08 20:01:08.556119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 355/742] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:08 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:08.578348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:08.578862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:08.584943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:08.585423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:08.585854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:08.586533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:08.587009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:08.587424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:08.663689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b872e050-1e66-4c6a-a663-c3d606a0d40b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089447 Sep 08 20:01:08.664287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 388/743] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 20:01:08 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:08.928623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:08.929230 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:08.935548 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:08.936078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:08.936560 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:08.937251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:08.937701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:08.938120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:09.069966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:09.077954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ae0ae441-c1cf-4cd4-953e-b80184c76958 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.153491 Sep 08 20:01:09.078537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 356/744] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:08 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:09.682236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-3bc8c7a7-6abc-4009-bb49-36073eb8cda2 req-5d2ffa5a-64b4-4717-99a4-07d0c18d6617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcbbdca-e7b1-4512-a75e-486b36e13cf8", "tag": "f28431b5-807d-4361-995f-3aac58e76ed9"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:09.692754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3bc8c7a7-6abc-4009-bb49-36073eb8cda2 req-5d2ffa5a-64b4-4717-99a4-07d0c18d6617 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:09.693690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3bc8c7a7-6abc-4009-bb49-36073eb8cda2 req-5d2ffa5a-64b4-4717-99a4-07d0c18d6617 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:09.694178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3bc8c7a7-6abc-4009-bb49-36073eb8cda2 req-5d2ffa5a-64b4-4717-99a4-07d0c18d6617 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:09.713039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-3bc8c7a7-6abc-4009-bb49-36073eb8cda2 req-5d2ffa5a-64b4-4717-99a4-07d0c18d6617 service nova] Creating event network-changed:f28431b5-807d-4361-995f-3aac58e76ed9 for instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 on hv-cinder-83124 Sep 08 20:01:09.719957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-3bc8c7a7-6abc-4009-bb49-36073eb8cda2 req-5d2ffa5a-64b4-4717-99a4-07d0c18d6617 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124509 Sep 08 20:01:09.721431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 389/745] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:10.103092 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:10.105104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:10.115665 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:10.116911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:10.117675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:10.119072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:10.119537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:10.119963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:10.333232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:10.354378 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a1a2393d-e61d-4efe-8b74-9f8a39a6f29d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.255998 Sep 08 20:01:10.355804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 357/746] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:10 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:11.381563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:11.382349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:11.390134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:11.390706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:11.391289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:11.392095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:11.392620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:11.393119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:11.546885 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:11.555143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4783d9b5-5b76-4530-bfab-6b7cbacd5d9b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.179450 Sep 08 20:01:11.555760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 390/747] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:11 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:11.739520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-6d37df98-7583-4c2a-ab3a-999e81a7fcad req-495b378a-57ac-461d-b578-5e01a0cdec8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bcbbdca-e7b1-4512-a75e-486b36e13cf8", "tag": "f28431b5-807d-4361-995f-3aac58e76ed9"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:11.745421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=80 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:11.751974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6d37df98-7583-4c2a-ab3a-999e81a7fcad req-495b378a-57ac-461d-b578-5e01a0cdec8c service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:11.752438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6d37df98-7583-4c2a-ab3a-999e81a7fcad req-495b378a-57ac-461d-b578-5e01a0cdec8c service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:11.752856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6d37df98-7583-4c2a-ab3a-999e81a7fcad req-495b378a-57ac-461d-b578-5e01a0cdec8c service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:11.764330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-6d37df98-7583-4c2a-ab3a-999e81a7fcad req-495b378a-57ac-461d-b578-5e01a0cdec8c service nova] Creating event network-changed:f28431b5-807d-4361-995f-3aac58e76ed9 for instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 on hv-cinder-83124 Sep 08 20:01:11.769802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-6d37df98-7583-4c2a-ab3a-999e81a7fcad req-495b378a-57ac-461d-b578-5e01a0cdec8c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034815 Sep 08 20:01:11.770589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 358/748] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:12.579133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:12.579814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:12.587558 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:12.588049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:12.588521 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:12.589217 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:12.589674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:12.590095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:12.727765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:12.738955 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b570d45a-65b5-4023-99e9-a4a918a0104a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1571 microversion: 2.1 time: 0.165314 Sep 08 20:01:12.739532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 391/749] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:12 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:12.764400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:12.765109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:12.771574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:12.772058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:12.772481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:12.773157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:12.773601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:12.774011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:12.920010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120485) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 20:01:12.988327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d89b3228-6f7c-4f6e-8b2f-3d45b7f98c12 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "POST /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d/action" status: 202 len: 0 microversion: 2.1 time: 0.228747 Sep 08 20:01:12.988939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 359/750] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:01:12 2022] POST /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 20:01:12.997504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:12.998183 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:13.004740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:13.005291 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:13.005786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:13.006541 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:13.007099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:13.007582 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:13.140101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:13.148201 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-37f54aff-76e1-4873-8364-2f8794fdc2df tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1519 microversion: 2.1 time: 0.155034 Sep 08 20:01:13.148958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 392/751] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:12 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:14.173343 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:14.173886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:14.180961 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:14.181542 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:14.181979 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:14.182684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:14.183189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:14.183577 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:14.317507 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:14.325530 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-694869fa-b403-472d-b5e5-b77d45b37a09 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1521 microversion: 2.1 time: 0.157622 Sep 08 20:01:14.326093 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 360/752] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:14 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:15.353895 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:15.354515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:15.361527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:15.362048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:15.362507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:15.363521 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:15.363962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:15.364369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:15.386738 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-4d38272c-2146-4899-a1cb-04fc83f04040 req-7f6ffede-cb5b-4019-a3b0-93a6554a9760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "name": "network-vif-unplugged", "status": "completed", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:15.399752 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-4d38272c-2146-4899-a1cb-04fc83f04040 req-7f6ffede-cb5b-4019-a3b0-93a6554a9760 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:15.400537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-4d38272c-2146-4899-a1cb-04fc83f04040 req-7f6ffede-cb5b-4019-a3b0-93a6554a9760 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:15.400971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-4d38272c-2146-4899-a1cb-04fc83f04040 req-7f6ffede-cb5b-4019-a3b0-93a6554a9760 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:15.412893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-4d38272c-2146-4899-a1cb-04fc83f04040 req-7f6ffede-cb5b-4019-a3b0-93a6554a9760 service nova] Creating event network-vif-unplugged:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 20:01:15.418229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-4d38272c-2146-4899-a1cb-04fc83f04040 req-7f6ffede-cb5b-4019-a3b0-93a6554a9760 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037286 Sep 08 20:01:15.419107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 361/753] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:15.583479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:15.592094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b8880a1c-fb81-43b2-bf11-be2adc4813e9 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.242147 Sep 08 20:01:15.592790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 393/754] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:15 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:16.620524 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:16.621685 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:16.630826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:16.631309 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:16.631739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:16.632436 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:16.632889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:16.633408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:16.779638 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:16.787551 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-db815223-f585-4293-8dec-3ed4c8f35f1d tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.175197 Sep 08 20:01:16.788129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 362/755] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:16 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:17.815741 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:17.816500 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:17.824343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:17.824942 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:17.825476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:17.826334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:17.826971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:17.827496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:17.963344 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:17.971341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-dfd16059-c0bd-4529-a25f-e5591953744a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.162382 Sep 08 20:01:17.971915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 394/756] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:17 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:18.999241 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:19.000063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:19.011062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:19.011860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:19.012568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:19.013697 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:19.014453 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:19.015193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:19.310840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:19.318800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c679202f-3f7d-4c07-be4a-61b88523c01a tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.326785 Sep 08 20:01:19.319371 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 363/757] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:18 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:20.346227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:20.347146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:20.354681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:20.355236 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:20.355723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:20.356499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:20.357009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:20.357485 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:20.504745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:20.512671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0349cf92-86a8-4885-b95c-3104ac3977c0 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.172970 Sep 08 20:01:20.513234 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 395/758] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:20 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:21.539776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:21.541141 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:21.551926 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:21.552685 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:21.553408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:21.554524 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:21.555303 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:21.555984 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:21.693094 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:21.701485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-82adaaf3-548f-4351-b3c0-1cbc5ad11fb6 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.168855 Sep 08 20:01:21.702048 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 364/759] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:21 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:22.732668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:22.733663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:22.742492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:22.743019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:22.743455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:22.744163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:22.744588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:22.745041 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:22.874244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:22.882121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9d683e1c-29fa-43ca-ab65-9f81fc70f155 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.155978 Sep 08 20:01:22.882690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 396/760] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:22 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:23.913734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:23.914716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:23.926075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:23.926804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:23.927240 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:23.927932 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:23.928382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:23.928798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:24.064294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:24.072235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8c1ebc9b-5004-4d35-9d1b-dd71b17c09e8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.164984 Sep 08 20:01:24.072797 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 365/761] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:23 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:25.099732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:25.100788 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:25.112018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:25.112815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:25.113568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:25.114708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:25.115475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:25.116173 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:25.261251 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:25.269820 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bbd19762-4a5a-4b47-9278-6c87a3a1e494 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1577 microversion: 2.1 time: 0.176646 Sep 08 20:01:25.270410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 397/762] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:25 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:25.464655 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-d01a01bc-79d4-448b-a0b2-74240fbbc808 req-c508001d-7957-4eed-8374-37129425ac2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "name": "network-vif-plugged", "status": "completed", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:25.477782 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d01a01bc-79d4-448b-a0b2-74240fbbc808 req-c508001d-7957-4eed-8374-37129425ac2b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:25.478565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d01a01bc-79d4-448b-a0b2-74240fbbc808 req-c508001d-7957-4eed-8374-37129425ac2b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:25.479529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d01a01bc-79d4-448b-a0b2-74240fbbc808 req-c508001d-7957-4eed-8374-37129425ac2b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:25.491618 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-d01a01bc-79d4-448b-a0b2-74240fbbc808 req-c508001d-7957-4eed-8374-37129425ac2b service nova] Creating event network-vif-plugged:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 20:01:25.497093 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-d01a01bc-79d4-448b-a0b2-74240fbbc808 req-c508001d-7957-4eed-8374-37129425ac2b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035847 Sep 08 20:01:25.497745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 366/763] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:26.296934 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:26.298008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:26.306016 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:26.306505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:26.306960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:26.307643 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:26.308093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:26.308512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:26.451742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:26.464500 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-59fc2d39-6c73-4079-a7eb-46d2e889513b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1564 microversion: 2.1 time: 0.173751 Sep 08 20:01:26.465350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 398/764] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:26 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:33.659196 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:33.661429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:33.667653 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:33.668137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:33.668572 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:33.669255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:33.669709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:33.670127 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:33.700242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-430a83b0-d972-4501-bcd1-b8002242280a tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045873 Sep 08 20:01:33.700800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 367/765] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:01:33 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:01:33.782082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:33.782706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:33.785155 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=36 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:33.790804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:33.791281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:33.791713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:33.792420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:33.792873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:33.793287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:33.818569 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:01:33.911214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d32fe672-151c-4706-9e46-8a49f7d9fbe4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 204 len: 0 microversion: 2.1 time: 0.132390 Sep 08 20:01:33.911814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 399/766] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:01:33 2022] DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:01:33.920186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:33.920795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:33.927162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:33.927655 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:33.928109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:33.928791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:33.929252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:33.929676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:34.065596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:34.074352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fe15d5c4-abda-4140-aba2-57bcf5db9632 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1673 microversion: 2.1 time: 0.157936 Sep 08 20:01:34.075415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 368/767] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:33 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:01:35.104152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:35.105166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:35.115630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:35.116122 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:35.116587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:35.117314 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:35.117768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:35.118191 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:35.252314 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:35.260667 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cd26f33b-f2c7-49db-a14b-5123f8080217 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1673 microversion: 2.1 time: 0.163746 Sep 08 20:01:35.261385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 400/768] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:35 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:36.140091 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-7460259c-fcbe-4c6c-8c09-880658dab790 req-ee2ee17d-a5f9-4e13-9b22-fcccbd6988fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c22bff83-6076-4522-87b8-762a5ee75a3f", "name": "network-vif-deleted", "tag": "aa0a5896-bbc1-43fe-818e-f9d2e827cbaa"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:36.150420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7460259c-fcbe-4c6c-8c09-880658dab790 req-ee2ee17d-a5f9-4e13-9b22-fcccbd6988fe service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:36.150886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7460259c-fcbe-4c6c-8c09-880658dab790 req-ee2ee17d-a5f9-4e13-9b22-fcccbd6988fe service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:36.151313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-7460259c-fcbe-4c6c-8c09-880658dab790 req-ee2ee17d-a5f9-4e13-9b22-fcccbd6988fe service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:36.163480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-7460259c-fcbe-4c6c-8c09-880658dab790 req-ee2ee17d-a5f9-4e13-9b22-fcccbd6988fe service nova] Creating event network-vif-deleted:aa0a5896-bbc1-43fe-818e-f9d2e827cbaa for instance c22bff83-6076-4522-87b8-762a5ee75a3f on hv-cinder-83124 Sep 08 20:01:36.169033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-7460259c-fcbe-4c6c-8c09-880658dab790 req-ee2ee17d-a5f9-4e13-9b22-fcccbd6988fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032585 Sep 08 20:01:36.169874 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 369/769] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:36.283578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:36.284851 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:36.292696 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:36.293373 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:36.293964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:36.294856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:36.295635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:36.296206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:36.335071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:36.336863 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:36.337292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:36.337743 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lazy-loading 'fault' on Instance uuid c22bff83-6076-4522-87b8-762a5ee75a3f {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:01:36.382419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:36.390768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9085181e-1691-4dc3-a89b-9f5bbc3a3099 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 200 len: 1327 microversion: 2.1 time: 0.110635 Sep 08 20:01:36.403865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 401/770] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:36 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:37.417009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:37.417776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:37.426012 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:37.426896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:37.427344 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:37.428050 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:37.428515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:37.428946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:37.431747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:37.446213 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] HTTP exception thrown: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Request method failure captured: Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f HTTP/1.1 Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhYmnU6HFeiZH7jDYCvoI_qI66fSKJ4MFwQTZzTfhSKAPU7g4XiMLXuUmgA7hvgn0LP05ClDvThfNzCS0DZUx2kc7hAy56bb7EP3DBr0kGLrbkVhX1j7xfLn1O0MChsriBhPeVuRNngQbOaU23lN6KiwrD9myX2S0dsxQ3Bb-S0T8w Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:01:37.447966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26f42f69c1b4f48b9a9746bfcc8fa5c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 14824e303e544aa6b206e0692f703e5a Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:01:37.449587 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'c22bff83-6076-4522-87b8-762a5ee75a3f'} Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:01:37.450827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:01:37.452081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:01:37.453245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Returning 404 to user: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:01:37.453245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4169081b-c4aa-43b3-b792-db20459e97f4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 404 len: 111 microversion: 2.1 time: 0.038608 Sep 08 20:01:37.453245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 370/771] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:37 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:01:37.458621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-10c3dba5-98d7-426d-a954-a861aadea5aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '.version_select at 0x7fef84be8820>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:37.479651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-10c3dba5-98d7-426d-a954-a861aadea5aa tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155869417" status: 202 len: 0 microversion: 2.1 time: 0.024929 Sep 08 20:01:37.480201 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 402/772] 10.222.0.44 () {58 vars in 1221 bytes} [Thu Sep 8 20:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155869417 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:01:38.145255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-68164fdc-c543-4c42-8b39-55e6cb769f24 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: .version_select at 0x7fef84aefe50>, body: {"keypair": {"name": "tempest-keypair-2118785364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBML+8LStNDISbPSEW95CcGXH+LB1e2rtaplmXv4Q/yEKWHa+JtS7vENC1ez4ilp4aZxp2mo9AYdl2C7/4N9tU7jABHSPBoziT5BLmlBOZnEegcLXys+xwPFIqpI2FjoRxg=="}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:38.162363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-68164fdc-c543-4c42-8b39-55e6cb769f24 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:01:38.166509 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-68164fdc-c543-4c42-8b39-55e6cb769f24 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for user 14824e303e544aa6b206e0692f703e5a and project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:01:38.192911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-68164fdc-c543-4c42-8b39-55e6cb769f24 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051926 Sep 08 20:01:38.193487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 371/773] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 20:01:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:01:39.731456 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1088601133", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41954cc4-6511-4766-b853-67fe7cbcb4e7"}], "security_groups": [{"name": "tempest-securitygroup--1422672621"}], "key_name": "tempest-keypair-2118785364", "user_data": "}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:39.837830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] validate_networks() for [('41954cc4-6511-4766-b853-67fe7cbcb4e7', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:01:40.218435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:01:40.218923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:01:40.219394 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:01:40.219793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:01:40.220202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:01:40.229734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:40.230211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:40.230685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:40.231396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:40.231819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:40.232258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:40.237843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:40.252939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:01:40.256954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Getting quotas for user 14824e303e544aa6b206e0692f703e5a and project f26f42f69c1b4f48b9a9746bfcc8fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:01:40.267690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:01:40.269965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:01:40.319087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8eba2fcb-9049-4ee0-9d75-a3146e4e2494 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.595340 Sep 08 20:01:40.319778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 403/774] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 20:01:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 20:01:40.331510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-831f0c46-0825-4347-ae5f-75655371ca7d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:40.332081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-831f0c46-0825-4347-ae5f-75655371ca7d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:40.394181 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-831f0c46-0825-4347-ae5f-75655371ca7d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:40.402257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-831f0c46-0825-4347-ae5f-75655371ca7d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1238 microversion: 2.1 time: 0.075273 Sep 08 20:01:40.402944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 372/775] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:40 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:41.429894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:41.431048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:41.441377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:41.442177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:41.442833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:41.443527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:41.443976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:41.444402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:41.518603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:41.526670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ec935c44-36bd-4793-a3e4-ccf7a26c8da0 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1290 microversion: 2.1 time: 0.104147 Sep 08 20:01:41.527577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 404/776] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:41 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:42.506666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-642056270"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:42.508175 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:42.510527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:42.524558 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:42.526322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:42.527058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:42.528485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:42.529017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:42.529575 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:42.550512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:42.551175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:42.558065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:42.558973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:42.559610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:42.560329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:42.560819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:42.561248 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:42.671448 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.network.security_group_api [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Removing security group 494b3023-b741-4cfa-af90-7a8ffce144f6 from port fffdab31-cb2a-4dae-9e01-98ae0d68568d Sep 08 20:01:42.753448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:42.762816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4514f382-25b7-41e5-b716-76af10fec1d3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.216106 Sep 08 20:01:42.763767 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 405/777] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:42 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:01:42.989786 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7d41a4d7-8c15-46c1-bf96-6a460006b5bf tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/action" status: 202 len: 0 microversion: 2.1 time: 0.487280 Sep 08 20:01:42.990402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 373/778] 10.222.0.44 () {60 vars in 1278 bytes} [Thu Sep 8 20:01:42 2022] POST /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:01:43.002240 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-a261fbec-bd79-425c-a7bc-48ca492424af req-14aad34d-f203-4cf7-8a7e-0d12f023f9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:43.015229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a261fbec-bd79-425c-a7bc-48ca492424af req-14aad34d-f203-4cf7-8a7e-0d12f023f9a2 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:43.016484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a261fbec-bd79-425c-a7bc-48ca492424af req-14aad34d-f203-4cf7-8a7e-0d12f023f9a2 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:43.017180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a261fbec-bd79-425c-a7bc-48ca492424af req-14aad34d-f203-4cf7-8a7e-0d12f023f9a2 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:43.032724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-a261fbec-bd79-425c-a7bc-48ca492424af req-14aad34d-f203-4cf7-8a7e-0d12f023f9a2 service nova] Creating event network-changed:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 20:01:43.043850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-a261fbec-bd79-425c-a7bc-48ca492424af req-14aad34d-f203-4cf7-8a7e-0d12f023f9a2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044990 Sep 08 20:01:43.045432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 406/779] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:43.095354 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-81a159e6-993b-4d09-8779-a28fcec1e112 req-58bc6b9d-c0f7-4087-8285-fbace1910597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bc412d-e701-4c39-832e-3c9c41b09d66", "tag": "4bf2756b-b7a5-4639-8b84-4b8b7068da2d"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:43.125787 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-81a159e6-993b-4d09-8779-a28fcec1e112 req-58bc6b9d-c0f7-4087-8285-fbace1910597 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:43.126876 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-81a159e6-993b-4d09-8779-a28fcec1e112 req-58bc6b9d-c0f7-4087-8285-fbace1910597 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:43.127553 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-81a159e6-993b-4d09-8779-a28fcec1e112 req-58bc6b9d-c0f7-4087-8285-fbace1910597 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:43.141852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-81a159e6-993b-4d09-8779-a28fcec1e112 req-58bc6b9d-c0f7-4087-8285-fbace1910597 service nova] Creating event network-changed:4bf2756b-b7a5-4639-8b84-4b8b7068da2d for instance c0bc412d-e701-4c39-832e-3c9c41b09d66 on hv-cinder-83124 Sep 08 20:01:43.149244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-81a159e6-993b-4d09-8779-a28fcec1e112 req-58bc6b9d-c0f7-4087-8285-fbace1910597 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065006 Sep 08 20:01:43.150627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 374/780] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:43.786134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:43.787651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:43.794522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:43.796064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:43.796721 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:43.797657 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:43.798319 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:43.798975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:44.025190 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:44.033082 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b6c4c65a-9f70-42e3-8767-8f23b23743f3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.251247 Sep 08 20:01:44.034317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 407/781] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:43 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:44.097838 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:44.098552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:44.105275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:44.105872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:44.106313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:44.107069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:44.107538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:44.107941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:44.196015 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lazy-loading 'services' on Instance uuid 07e27f43-33de-4565-b6a8-171abd7acd17 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:01:44.271107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8c8466fe-c055-48e5-9748-0b4f3850cb69 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments/5254fb0e-1b82-430e-8ee4-74732b7aa1e6" status: 202 len: 0 microversion: 2.1 time: 0.178079 Sep 08 20:01:44.272120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 375/782] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:01:44 2022] DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments/5254fb0e-1b82-430e-8ee4-74732b7aa1e6 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:01:44.280627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:44.282915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:44.288836 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:44.289328 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:44.289766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:44.290461 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:44.290948 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:44.291375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:44.321166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a89b07d9-4a0d-4a6c-9442-49a720124d1b tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044489 Sep 08 20:01:44.321653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 408/783] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:01:44 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:45.060514 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-60a907c3-e878-403f-aa9f-8f2806f1bb9d req-fa545901-801b-4029-a26e-53b1e5845349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:45.068644 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:45.069322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:45.075958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-60a907c3-e878-403f-aa9f-8f2806f1bb9d req-fa545901-801b-4029-a26e-53b1e5845349 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:45.076147 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:45.076477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-60a907c3-e878-403f-aa9f-8f2806f1bb9d req-fa545901-801b-4029-a26e-53b1e5845349 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:45.076733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:45.076905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-60a907c3-e878-403f-aa9f-8f2806f1bb9d req-fa545901-801b-4029-a26e-53b1e5845349 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:45.077184 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:45.077895 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:45.078508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:45.079069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:45.089003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-60a907c3-e878-403f-aa9f-8f2806f1bb9d req-fa545901-801b-4029-a26e-53b1e5845349 service nova] Creating event network-changed:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 20:01:45.093969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-60a907c3-e878-403f-aa9f-8f2806f1bb9d req-fa545901-801b-4029-a26e-53b1e5845349 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036997 Sep 08 20:01:45.094875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 409/784] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:45.216165 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:45.224129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-97c982e1-5f82-4cb3-b6a6-fdf1ed324b07 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.170995 Sep 08 20:01:45.224766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 376/785] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:45 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:45.339039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:45.342686 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:45.351642 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:45.352055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:45.352505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:45.353194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:45.353623 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:45.354043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:45.386570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-206ad788-c942-4e3e-a331-f6a089aa1805 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054906 Sep 08 20:01:45.387149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 410/786] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:01:45 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:46.250035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:46.250751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:46.260777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:46.261602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:46.262300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:46.263443 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:46.264157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:46.264747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:46.399552 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:46.400132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:46.402381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:46.408471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-343899ea-cb87-43d4-bcd6-9a9f7ea1f4be tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.164919 Sep 08 20:01:46.409065 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 377/787] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:46 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:46.409210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:46.409730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:46.410159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:46.410850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:46.411578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:46.411987 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:46.444308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bac3b90c-049b-4896-82d1-91a6349fe251 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048678 Sep 08 20:01:46.444868 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 411/788] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:01:46 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:47.431052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:47.431744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:47.440588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:47.441331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:47.441478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:47.442202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:47.442697 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:47.443315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:47.457169 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:47.459613 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:47.471346 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:47.471838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:47.472289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:47.473011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:47.473440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:47.473968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:47.522451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-05822d76-ea54-4fb3-a28c-e863c5876c81 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069243 Sep 08 20:01:47.523676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 412/789] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:01:47 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:01:47.534465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:47.535516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:47.543705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:47.547029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:47.547596 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:47.548835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:47.551301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:47.552246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:47.636047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:47.641137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] HTTP exception thrown: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 is not attached to volume 5254fb0e-1b82-430e-8ee4-74732b7aa1e6 Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Request method failure captured: Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments/5254fb0e-1b82-430e-8ee4-74732b7aa1e6 HTTP/1.1 Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkkDKc9jiixX2is6c1APYEjAfLqw69Wyo_lv0fYcstt1-q2_505aiz9pPhwk4skZCKsNQsjqcMXoCamKCFdJ5wtkLdvUZ8yZaFdD_-8oA6OV6EL3wJhhgHEmv7XEBrJ7OerhLcgzcqtaSxjkWw65Ne_MpiXgIC5Lo9CjJkOdyjvGjcU Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: bf41001e3485494e94a2080e4941114a Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-TestMinimumBasicScenario-396261447 Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:01:47.643717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf41001e3485494e94a2080e4941114a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf41001e3485494e94a2080e4941114a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf41001e3485494e94a2080e4941114a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf41001e3485494e94a2080e4941114a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-TestMinimumBasicScenario-396261447 Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: bf41001e3485494e94a2080e4941114a Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-TestMinimumBasicScenario-396261447 Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-TestMinimumBasicScenario-396261447-project Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: e00ffc7f2df6418ab6328781d9d38f63 Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-TestMinimumBasicScenario-396261447-project Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:01:47.645066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 is not attached to volume 5254fb0e-1b82-430e-8ee4-74732b7aa1e6 Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'server_id': '07e27f43-33de-4565-b6a8-171abd7acd17', 'id': '5254fb0e-1b82-430e-8ee4-74732b7aa1e6'} Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5254fb0e-1b82-430e-8ee4-74732b7aa1e6. Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:01:47.645835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 is not attached to volume 5254fb0e-1b82-430e-8ee4-74732b7aa1e6 Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 is not attached to volume 5254fb0e-1b82-430e-8ee4-74732b7aa1e6 Sep 08 20:01:47.647022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:47.647903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-85d5ea0e-ccf0-43b0-9baa-63a9d7aa0cfd tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.217938 Sep 08 20:01:47.649644 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Returning 404 to user: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 is not attached to volume 5254fb0e-1b82-430e-8ee4-74732b7aa1e6 {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:01:47.650740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a9b86f15-ebc4-4480-bc0a-e6b69267ec78 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments/5254fb0e-1b82-430e-8ee4-74732b7aa1e6" status: 404 len: 154 microversion: 2.1 time: 0.120497 Sep 08 20:01:47.658807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 378/791] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:47 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:47.662730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 413/791] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:01:47 2022] DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17/os-volume_attachments/5254fb0e-1b82-430e-8ee4-74732b7aa1e6 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 20:01:48.672383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:48.673386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:48.681911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:48.682403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:48.682878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:48.683576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:48.684030 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:48.684451 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:48.818863 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:48.819381 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:48.820743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:48.826167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:48.826905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:48.827338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:48.828035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:48.828455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:48.828588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5bff21f7-8682-4655-9be0-ec7dceedd6a1 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.162791 Sep 08 20:01:48.828881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:48.829190 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 379/792] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:48 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:48.854407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:01:48.936244 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ce4c0cb9-4edb-4541-8603-ef8a328429dc tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 204 len: 0 microversion: 2.1 time: 0.121308 Sep 08 20:01:48.936855 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 414/793] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:01:48 2022] DELETE /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:01:48.946152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:48.946840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:48.953034 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:48.953525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:48.953961 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:48.954678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:48.955132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:48.955557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:49.086854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:49.095041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7eccb2e2-ca52-465b-afcd-4d3b5ef30134 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1554 microversion: 2.1 time: 0.153500 Sep 08 20:01:49.095610 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 380/794] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:48 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:01:49.638771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-ac98b754-5b6a-4fd0-a526-ab2a88ee3c81 req-e0cdea14-af58-4da0-85d4-3aba713047e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bc412d-e701-4c39-832e-3c9c41b09d66", "name": "network-vif-plugged", "status": "completed", "tag": "4bf2756b-b7a5-4639-8b84-4b8b7068da2d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:49.649021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-ac98b754-5b6a-4fd0-a526-ab2a88ee3c81 req-e0cdea14-af58-4da0-85d4-3aba713047e2 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:49.649509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-ac98b754-5b6a-4fd0-a526-ab2a88ee3c81 req-e0cdea14-af58-4da0-85d4-3aba713047e2 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:49.650013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-ac98b754-5b6a-4fd0-a526-ab2a88ee3c81 req-e0cdea14-af58-4da0-85d4-3aba713047e2 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:49.661119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-ac98b754-5b6a-4fd0-a526-ab2a88ee3c81 req-e0cdea14-af58-4da0-85d4-3aba713047e2 service nova] Creating event network-vif-plugged:4bf2756b-b7a5-4639-8b84-4b8b7068da2d for instance c0bc412d-e701-4c39-832e-3c9c41b09d66 on hv-cinder-83124 Sep 08 20:01:49.665943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-ac98b754-5b6a-4fd0-a526-ab2a88ee3c81 req-e0cdea14-af58-4da0-85d4-3aba713047e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Sep 08 20:01:49.666559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 415/795] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:49.854825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:49.855623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:49.864594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:49.865236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:49.865804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:49.866759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:49.867363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:49.867923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:50.006202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:50.018140 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-32c04158-8922-435a-a682-9a4ece81fadf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.168210 Sep 08 20:01:50.018987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 381/796] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:49 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:50.121258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:50.122393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:50.129393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:50.129878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:50.130308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:50.131076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:50.131481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:50.131901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:50.238452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:50.263906 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=6 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:50.267866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:50.276523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-be5156c9-6a23-48f3-9da3-ff02cb22059f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1554 microversion: 2.1 time: 0.160562 Sep 08 20:01:50.277092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 416/797] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:50 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:51.045273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:51.046263 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:51.049399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=6 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:01:51.056524 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:51.057005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:51.057432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:51.058119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:51.058568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:51.059024 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:51.198461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:51.206393 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4904a279-9837-47ff-bf49-c8b693bcb5e3 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.167725 Sep 08 20:01:51.207017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 382/798] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:51 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:51.303610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:51.304428 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:51.315734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:51.316542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:51.317260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:51.318228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:51.318676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:51.319123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:51.469632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:51.482217 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1a29b975-256d-489d-8442-3d6f2483f88f tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1554 microversion: 2.1 time: 0.184867 Sep 08 20:01:51.482989 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 417/799] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:51 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:52.229461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:52.230072 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:52.236691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:52.237177 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:52.237619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:52.238331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:52.238796 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:52.239244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:52.364391 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-8a220dee-9fe9-4b9f-b8a3-fcb676df11b4 req-22dccb59-862f-47d6-a061-6b61c31072ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e27f43-33de-4565-b6a8-171abd7acd17", "name": "network-vif-deleted", "tag": "fffdab31-cb2a-4dae-9e01-98ae0d68568d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:52.374965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-8a220dee-9fe9-4b9f-b8a3-fcb676df11b4 req-22dccb59-862f-47d6-a061-6b61c31072ac service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:52.375679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-8a220dee-9fe9-4b9f-b8a3-fcb676df11b4 req-22dccb59-862f-47d6-a061-6b61c31072ac service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:52.376268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-8a220dee-9fe9-4b9f-b8a3-fcb676df11b4 req-22dccb59-862f-47d6-a061-6b61c31072ac service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:52.390092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-8a220dee-9fe9-4b9f-b8a3-fcb676df11b4 req-22dccb59-862f-47d6-a061-6b61c31072ac service nova] Creating event network-vif-deleted:fffdab31-cb2a-4dae-9e01-98ae0d68568d for instance 07e27f43-33de-4565-b6a8-171abd7acd17 on hv-cinder-83124 Sep 08 20:01:52.395015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-8a220dee-9fe9-4b9f-b8a3-fcb676df11b4 req-22dccb59-862f-47d6-a061-6b61c31072ac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034323 Sep 08 20:01:52.395666 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 418/800] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:01:52.407085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:52.414766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-192acef7-d78e-47d3-bc92-df5e4d71893b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1364 microversion: 2.1 time: 0.189267 Sep 08 20:01:52.415330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 383/801] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:52 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:52.508064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:52.508763 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:52.515276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:52.515771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:52.516206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:52.516903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:52.517364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:52.517791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:52.579681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e00ffc7f2df6418ab6328781d9d38f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf41001e3485494e94a2080e4941114a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:52.588107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-26f6dd67-7eb5-4660-a35f-a5cc921a977a tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 200 len: 1512 microversion: 2.1 time: 0.084290 Sep 08 20:01:52.588601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 419/802] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:52 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:53.436716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:53.437318 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:53.443994 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:53.444494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:53.444911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:53.445610 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:53.446058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:53.446480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:53.589865 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:01:53.598005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1c8269d9-d785-483e-85df-19109e38fb04 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1550 microversion: 2.1 time: 0.165300 Sep 08 20:01:53.598614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 384/803] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:53 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:01:53.610859 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:53.611469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] [instance: 07e27f43-33de-4565-b6a8-171abd7acd17] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:53.618175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:53.618691 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:53.619127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:53.619675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:53.619818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:53.620160 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:01:53.620268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:53.620697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:53.626713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:53.627245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:53.627677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:53.628362 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:53.628835 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:53.629247 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:53.634988 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] HTTP exception thrown: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 could not be found. Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Request method failure captured: Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 HTTP/1.1 Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkkDKc9jiixX2is6c1APYEjAfLqw69Wyo_lv0fYcstt1-q2_505aiz9pPhwk4skZCKsNQsjqcMXoCamKCFdJ5wtkLdvUZ8yZaFdD_-8oA6OV6EL3wJhhgHEmv7XEBrJ7OerhLcgzcqtaSxjkWw65Ne_MpiXgIC5Lo9CjJkOdyjvGjcU Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: bf41001e3485494e94a2080e4941114a Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-TestMinimumBasicScenario-396261447 Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:01:53.636626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf41001e3485494e94a2080e4941114a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_bf41001e3485494e94a2080e4941114a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/bf41001e3485494e94a2080e4941114a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/bf41001e3485494e94a2080e4941114a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-TestMinimumBasicScenario-396261447 Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: bf41001e3485494e94a2080e4941114a Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-TestMinimumBasicScenario-396261447 Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-TestMinimumBasicScenario-396261447-project Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: e00ffc7f2df6418ab6328781d9d38f63 Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-TestMinimumBasicScenario-396261447-project Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 could not be found. Sep 08 20:01:53.638235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '07e27f43-33de-4565-b6a8-171abd7acd17'} Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 could not be found. Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:01:53.639059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 could not be found. Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 could not be found. Sep 08 20:01:53.640466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:01:53.641607 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Returning 404 to user: Instance 07e27f43-33de-4565-b6a8-171abd7acd17 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:01:53.641607 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a58dbf42-4530-48f3-a16e-9691d0127f18 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17" status: 404 len: 111 microversion: 2.1 time: 0.031058 Sep 08 20:01:53.641607 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 420/804] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:01:53 2022] GET /compute/v2.1/servers/07e27f43-33de-4565-b6a8-171abd7acd17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:01:53.646688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6a259903-e6b8-48a7-b9de-bea03fb42274 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] Calling method '.version_select at 0x7fef84d2faf0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:01:53.666275 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6a259903-e6b8-48a7-b9de-bea03fb42274 tempest-TestMinimumBasicScenario-396261447 tempest-TestMinimumBasicScenario-396261447-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-839273250" status: 202 len: 0 microversion: 2.1 time: 0.023112 Sep 08 20:01:53.667190 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 421/805] 10.222.0.44 () {58 vars in 1269 bytes} [Thu Sep 8 20:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-839273250 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:01:53.709296 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-253ac3ac-2a12-4e8f-ad54-0d78421f0279 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092696 Sep 08 20:01:53.709903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 385/806] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 20:01:53 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:01:54.669240 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-16ccdd0d-fba0-4e00-b7cd-3c63d6654d05 req-67d78c9d-1b0a-4b36-9097-446b63b2d3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bc412d-e701-4c39-832e-3c9c41b09d66", "tag": "4bf2756b-b7a5-4639-8b84-4b8b7068da2d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:01:54.679096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-16ccdd0d-fba0-4e00-b7cd-3c63d6654d05 req-67d78c9d-1b0a-4b36-9097-446b63b2d3f3 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:01:54.679707 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-16ccdd0d-fba0-4e00-b7cd-3c63d6654d05 req-67d78c9d-1b0a-4b36-9097-446b63b2d3f3 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:01:54.680232 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-16ccdd0d-fba0-4e00-b7cd-3c63d6654d05 req-67d78c9d-1b0a-4b36-9097-446b63b2d3f3 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:01:54.691115 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-16ccdd0d-fba0-4e00-b7cd-3c63d6654d05 req-67d78c9d-1b0a-4b36-9097-446b63b2d3f3 service nova] Creating event network-changed:4bf2756b-b7a5-4639-8b84-4b8b7068da2d for instance c0bc412d-e701-4c39-832e-3c9c41b09d66 on hv-cinder-83124 Sep 08 20:01:54.696647 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-16ccdd0d-fba0-4e00-b7cd-3c63d6654d05 req-67d78c9d-1b0a-4b36-9097-446b63b2d3f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032247 Sep 08 20:01:54.697622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 422/807] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:16.089486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=25 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:16.090372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:16.096163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:16.096827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:16.104985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:16.105495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:16.105933 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:16.106627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:16.107114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:16.107539 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:16.202828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lazy-loading 'services' on Instance uuid 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:02:16.282051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-578e7da0-b351-42bb-930f-bf1a20bcf98a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments/2ee2cf66-8c2b-4889-83cb-627afc1c9dd4" status: 202 len: 0 microversion: 2.1 time: 0.194955 Sep 08 20:02:16.282612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 386/808] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:02:16 2022] DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments/2ee2cf66-8c2b-4889-83cb-627afc1c9dd4 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:02:16.289194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:16.289949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:16.294293 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:16.296562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:16.304189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:16.304615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:16.305033 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:16.305732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:16.306183 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:16.306606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:16.341889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a5e4741f-951e-4aa8-990b-d791dd86396a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054404 Sep 08 20:02:16.342437 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 423/809] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:02:16 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:17.360531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:17.364529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:17.376818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:17.377734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:17.378520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:17.379784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:17.380566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:17.381286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:17.411515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-12973329-46aa-47b9-83d4-fd85b491ef61 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059081 Sep 08 20:02:17.412098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 387/810] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:02:17 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:02:17.495963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:17.496852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:17.503481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:17.503969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:17.504410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:17.505116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:17.505572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:17.506000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:17.531346 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:02:17.611386 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-103e2b9f-8f23-4f33-8af5-92581ac51d9c tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 204 len: 0 microversion: 2.1 time: 0.119170 Sep 08 20:02:17.611996 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 424/811] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:02:17 2022] DELETE /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:02:17.620841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:17.621825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:17.628039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:17.628522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:17.628959 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:17.629631 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:17.630080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:17.630497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:17.766097 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:17.774624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-47fb9c41-39df-40c3-ad22-af6209a364a3 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1690 microversion: 2.1 time: 0.158034 Sep 08 20:02:17.775220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 388/812] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:17 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:18.802583 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:18.803671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:18.814406 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:18.815263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:18.815988 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:18.817133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:18.817901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:18.818609 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:18.963265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:18.971530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a46224ed-3838-42a8-baad-070a7460af64 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1690 microversion: 2.1 time: 0.176261 Sep 08 20:02:18.972110 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 425/813] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:18 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:19.999419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:20.000278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:20.011392 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:20.012205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:20.012929 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:20.014075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:20.014893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:20.015599 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:20.160948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:20.172962 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2510c139-42ca-4ec5-ab9f-d39dbbad9131 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1690 microversion: 2.1 time: 0.180732 Sep 08 20:02:20.173734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 389/814] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:19 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:21.196147 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:21.196755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:21.203802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:21.204290 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:21.204722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:21.205413 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:21.205863 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:21.206290 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:21.343116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:21.352651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-50e84178-f5f4-40f9-b461-8c539263e426 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1690 microversion: 2.1 time: 0.160476 Sep 08 20:02:21.353225 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 426/815] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:21 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:22.377790 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:22.378359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:22.385447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:22.386051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:22.386594 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:22.387439 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:22.387977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:22.388474 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:22.456900 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:22.465400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5c44ad81-c8f4-4015-af64-6c9f6f6425a2 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 200 len: 1623 microversion: 2.1 time: 0.092492 Sep 08 20:02:22.465987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 390/816] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:22 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 1623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:22.579635 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-84f65183-f81b-41e0-b63b-19237f0194bc req-d4e6af13-d88f-44ad-bac2-29087591edab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bcbbdca-e7b1-4512-a75e-486b36e13cf8", "name": "network-vif-deleted", "tag": "f28431b5-807d-4361-995f-3aac58e76ed9"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:22.589603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-84f65183-f81b-41e0-b63b-19237f0194bc req-d4e6af13-d88f-44ad-bac2-29087591edab service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:22.590075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-84f65183-f81b-41e0-b63b-19237f0194bc req-d4e6af13-d88f-44ad-bac2-29087591edab service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:22.590495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-84f65183-f81b-41e0-b63b-19237f0194bc req-d4e6af13-d88f-44ad-bac2-29087591edab service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:22.602181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-84f65183-f81b-41e0-b63b-19237f0194bc req-d4e6af13-d88f-44ad-bac2-29087591edab service nova] Creating event network-vif-deleted:f28431b5-807d-4361-995f-3aac58e76ed9 for instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 on hv-cinder-83124 Sep 08 20:02:22.607812 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-84f65183-f81b-41e0-b63b-19237f0194bc req-d4e6af13-d88f-44ad-bac2-29087591edab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032618 Sep 08 20:02:22.608414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 427/817] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:23.488610 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:23.489213 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: 7bcbbdca-e7b1-4512-a75e-486b36e13cf8] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:23.495986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:23.496803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:23.497231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:23.497921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:23.498377 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:23.498823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:23.512585 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] HTTP exception thrown: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 could not be found. Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Request method failure captured: Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 HTTP/1.1 Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGki8d-OB0eDZ6Vkt6UGghZDoe2rkUKNqUW6RrQAoj2pXCX_uM4l3YTYgJNBXCXNPa9PrTw2ITxH4qPaSK3uqdgFCHkVqTNenktwQlSFFXyhCqUbJ-xQ214ld5YWe70ZxxMqS30CGwHbQL0h7zEh7W6EeSS_lEVvvtoj__iGRWZgYx5c Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:02:23.514242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_933256f83bff41ff986dd79bd06a6b74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 628b75f16eb14ce1b7deed61ade28b9c Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 could not be found. Sep 08 20:02:23.515672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '7bcbbdca-e7b1-4512-a75e-486b36e13cf8'} Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 could not be found. Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:02:23.516939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 could not be found. Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 could not be found. Sep 08 20:02:23.518239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:23.520179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Returning 404 to user: Instance 7bcbbdca-e7b1-4512-a75e-486b36e13cf8 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:02:23.520179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-58a32ee5-ee90-4abe-beef-bff27d70a3d1 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8" status: 404 len: 111 microversion: 2.1 time: 0.031074 Sep 08 20:02:23.520179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 391/818] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:23 2022] GET /compute/v2.1/servers/7bcbbdca-e7b1-4512-a75e-486b36e13cf8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:02:23.524967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-dcb5fcb8-14e4-47d0-b02f-2cd2d83203b0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '.version_select at 0x7fef84bfd160>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:23.545813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-dcb5fcb8-14e4-47d0-b02f-2cd2d83203b0 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616801241" status: 202 len: 0 microversion: 2.1 time: 0.024900 Sep 08 20:02:23.546442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 428/819] 10.222.0.44 () {58 vars in 1218 bytes} [Thu Sep 8 20:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616801241 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:02:26.463484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:26.464037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:26.470964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:26.471478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:26.471909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:26.472604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:26.473059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:26.473475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:26.499027 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:02:26.579555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-19dbdbf8-1597-48bf-a548-2c2214241b0a tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 204 len: 0 microversion: 2.1 time: 0.119576 Sep 08 20:02:26.580151 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 392/820] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:02:26 2022] DELETE /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:02:26.589131 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:26.590065 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:26.598513 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:26.599060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:26.599493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:26.600181 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:26.600630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:26.601049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:26.731639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:26.739587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-17139eb3-c053-4c4c-8046-597be49f1d9b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1508 microversion: 2.1 time: 0.155095 Sep 08 20:02:26.740130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 429/821] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:26 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:27.763732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:27.765145 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:27.771890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:27.772475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:27.773007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:27.773911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:27.774577 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:27.775189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:27.790924 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-85273cf2-5d08-42db-ba66-2083626f63b8 req-1f1b8390-0a85-4680-8f05-666980619f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d470ae15-2b48-42c9-a170-e44ff12fbdc6", "name": "network-vif-deleted", "tag": "925fa7d3-cd56-4e4e-bfbe-82f2d2c3286a"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:27.809054 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-85273cf2-5d08-42db-ba66-2083626f63b8 req-1f1b8390-0a85-4680-8f05-666980619f24 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:27.809565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-85273cf2-5d08-42db-ba66-2083626f63b8 req-1f1b8390-0a85-4680-8f05-666980619f24 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:27.809969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-85273cf2-5d08-42db-ba66-2083626f63b8 req-1f1b8390-0a85-4680-8f05-666980619f24 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:27.824499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-85273cf2-5d08-42db-ba66-2083626f63b8 req-1f1b8390-0a85-4680-8f05-666980619f24 service nova] Creating event network-vif-deleted:925fa7d3-cd56-4e4e-bfbe-82f2d2c3286a for instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 on hv-cinder-83124 Sep 08 20:02:27.831066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-85273cf2-5d08-42db-ba66-2083626f63b8 req-1f1b8390-0a85-4680-8f05-666980619f24 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043599 Sep 08 20:02:27.836118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 430/822] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:27.872949 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:27.882150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ec0516ac-e6d5-42a9-837e-6024c12fbcc5 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 200 len: 1466 microversion: 2.1 time: 0.122801 Sep 08 20:02:27.882885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 393/823] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:27 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 1466 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:28.908156 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:28.908723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: d470ae15-2b48-42c9-a170-e44ff12fbdc6] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:28.915921 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:28.916404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:28.916838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:28.917538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:28.917993 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:28.918420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:28.933034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] HTTP exception thrown: Instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 could not be found. Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Request method failure captured: Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 HTTP/1.1 Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGki8d-OB0eDZ6Vkt6UGghZDoe2rkUKNqUW6RrQAoj2pXCX_uM4l3YTYgJNBXCXNPa9PrTw2ITxH4qPaSK3uqdgFCHkVqTNenktwQlSFFXyhCqUbJ-xQ214ld5YWe70ZxxMqS30CGwHbQL0h7zEh7W6EeSS_lEVvvtoj__iGRWZgYx5c Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:02:28.934754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_933256f83bff41ff986dd79bd06a6b74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 628b75f16eb14ce1b7deed61ade28b9c Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 could not be found. Sep 08 20:02:28.936487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'd470ae15-2b48-42c9-a170-e44ff12fbdc6'} Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 could not be found. Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:02:28.937476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 could not be found. Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 could not be found. Sep 08 20:02:28.939064 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:02:28.940772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Returning 404 to user: Instance d470ae15-2b48-42c9-a170-e44ff12fbdc6 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:02:28.940772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a4ff3fbd-a26a-4f34-8d32-1ffbb520841b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6" status: 404 len: 111 microversion: 2.1 time: 0.032995 Sep 08 20:02:28.940772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 431/824] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:28 2022] GET /compute/v2.1/servers/d470ae15-2b48-42c9-a170-e44ff12fbdc6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:02:28.948066 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:28.948872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:28.957718 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:28.958220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:28.958674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:28.959399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:28.959857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:28.960282 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:28.985990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:02:29.065906 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-91991804-1f33-487f-86fb-b8bfe558ac7d tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 204 len: 0 microversion: 2.1 time: 0.124011 Sep 08 20:02:29.066882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 394/825] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:02:28 2022] DELETE /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:02:29.077008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:29.077687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:29.084280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:29.084767 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:29.085202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:29.085891 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:29.086348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:29.086836 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:29.225149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:29.233529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-acd477bb-5a9f-41ef-a3a7-472cc7c04c7b tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1521 microversion: 2.1 time: 0.161561 Sep 08 20:02:29.234099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 432/826] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:29 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:30.207830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-32ec721a-963c-4cb7-9a85-5d9ddabbdefb req-d5da56d7-ba90-428c-9cc0-f30121f5fdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59f3554-3121-47a3-8819-0763cdbc8c31", "name": "network-vif-deleted", "tag": "7717f928-407f-44bf-be21-24013ca200b5"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:30.218612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-32ec721a-963c-4cb7-9a85-5d9ddabbdefb req-d5da56d7-ba90-428c-9cc0-f30121f5fdc7 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:30.219077 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-32ec721a-963c-4cb7-9a85-5d9ddabbdefb req-d5da56d7-ba90-428c-9cc0-f30121f5fdc7 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:30.219854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-32ec721a-963c-4cb7-9a85-5d9ddabbdefb req-d5da56d7-ba90-428c-9cc0-f30121f5fdc7 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:30.232425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-32ec721a-963c-4cb7-9a85-5d9ddabbdefb req-d5da56d7-ba90-428c-9cc0-f30121f5fdc7 service nova] Creating event network-vif-deleted:7717f928-407f-44bf-be21-24013ca200b5 for instance e59f3554-3121-47a3-8819-0763cdbc8c31 on hv-cinder-83124 Sep 08 20:02:30.238253 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-32ec721a-963c-4cb7-9a85-5d9ddabbdefb req-d5da56d7-ba90-428c-9cc0-f30121f5fdc7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034922 Sep 08 20:02:30.239112 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 395/827] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:30.257559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:30.258292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:30.264773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:30.265267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:30.265801 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:30.266513 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:30.266997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:30.267427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:30.336947 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '628b75f16eb14ce1b7deed61ade28b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933256f83bff41ff986dd79bd06a6b74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:30.346489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-924ae41f-752e-4cb0-b1f7-8a100c7f0543 tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 200 len: 1306 microversion: 2.1 time: 0.093430 Sep 08 20:02:30.347094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 433/828] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:30 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:31.373105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:31.373980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] [instance: e59f3554-3121-47a3-8819-0763cdbc8c31] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:31.382357 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:31.383042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:31.383630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:31.384561 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:31.385169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:31.385730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:31.400673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] HTTP exception thrown: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 could not be found. Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Request method failure captured: Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 HTTP/1.1 Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGki8d-OB0eDZ6Vkt6UGghZDoe2rkUKNqUW6RrQAoj2pXCX_uM4l3YTYgJNBXCXNPa9PrTw2ITxH4qPaSK3uqdgFCHkVqTNenktwQlSFFXyhCqUbJ-xQ214ld5YWe70ZxxMqS30CGwHbQL0h7zEh7W6EeSS_lEVvvtoj__iGRWZgYx5c Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:02:31.402328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_933256f83bff41ff986dd79bd06a6b74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/933256f83bff41ff986dd79bd06a6b74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 933256f83bff41ff986dd79bd06a6b74 Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1008816240 Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 628b75f16eb14ce1b7deed61ade28b9c Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1008816240-project Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 could not be found. Sep 08 20:02:31.404033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'e59f3554-3121-47a3-8819-0763cdbc8c31'} Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 could not be found. Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:02:31.404944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 could not be found. Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 could not be found. Sep 08 20:02:31.406399 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:31.407890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] Returning 404 to user: Instance e59f3554-3121-47a3-8819-0763cdbc8c31 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:02:31.407890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bfd7a3aa-15ef-4ac1-a2ca-43478d0d52ea tempest-ServerRescueNegativeTestJSON-1008816240 tempest-ServerRescueNegativeTestJSON-1008816240-project] 10.222.0.44 "GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31" status: 404 len: 111 microversion: 2.1 time: 0.037698 Sep 08 20:02:31.407890 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 396/829] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:31 2022] GET /compute/v2.1/servers/e59f3554-3121-47a3-8819-0763cdbc8c31 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:02:31.437915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:31.438451 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:31.445311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:31.445774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:31.446206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:31.446952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:31.447387 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:31.448001 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:31.471045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-48c8bc52-6c6d-44e7-bc5c-6c37dd2e4ad9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/ips" status: 200 len: 149 microversion: 2.1 time: 0.037065 Sep 08 20:02:31.471608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 434/830] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 20:02:31 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:32.818834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a3eece2-3ff2-432e-9848-b8787876b9d7"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:32.821270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:32.827867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:32.828537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:32.829042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:32.829825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:32.830381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:32.830892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:33.076785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e6afbc52-b90d-428c-ad0e-7c8964e395d2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261775 Sep 08 20:02:33.077666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 397/831] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:02:32 2022] POST /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:40.257949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-86acc4eb-aecb-4eaa-96ab-b8c16a5ccac0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'create', calling method: .version_select at 0x7fef84bfda60>, body: {"keypair": {"name": "tempest-keypair-268392082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6i7a/TsCKzdjjFgk5xmmBpPRrYAQWtCW5cxUoplgnBg3Qp5lEbNX7Vs9vUYl/0osFpkICAxmfbng+qO5q6qaWUzW+83aoJ7lvpXjq1NKbn9OhvCa6c/+uNkekW0/QZbQ=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:40.275427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-86acc4eb-aecb-4eaa-96ab-b8c16a5ccac0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for project 5600d866afb84f53882c2a5fb07298b4. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:02:40.280012 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-86acc4eb-aecb-4eaa-96ab-b8c16a5ccac0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for user e582f450b96c4e37ad88501bfa02441e and project 5600d866afb84f53882c2a5fb07298b4. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:02:40.305974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-86acc4eb-aecb-4eaa-96ab-b8c16a5ccac0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.218101 Sep 08 20:02:40.306584 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 435/832] 10.222.0.44 () {62 vars in 1200 bytes} [Thu Sep 8 20:02:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 219 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 20:02:40.786179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a3eece2-3ff2-432e-9848-b8787876b9d7"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:40.788972 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:40.796826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:40.797646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:40.798300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:40.799211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:40.800046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:40.805493 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:40.893804 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Invalid volume: volume 3a3eece2-3ff2-432e-9848-b8787876b9d7 is already attached to instances: 36e3493f-fd10-45d6-bc85-4456db192b87 Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: POST /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments HTTP/1.1 Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 74 Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:02:40.896314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {"volumeAttachment": {"volumeId": "3a3eece2-3ff2-432e-9848-b8787876b9d7"}} Sep 08 20:02:40.897909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Invalid volume: volume 3a3eece2-3ff2-432e-9848-b8787876b9d7 is already attached to instances: 36e3493f-fd10-45d6-bc85-4456db192b87 Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'server_id': '36e3493f-fd10-45d6-bc85-4456db192b87', 'body': {'volumeAttachment': {'volumeId': '3a3eece2-3ff2-432e-9848-b8787876b9d7'}}} Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3a3eece2-3ff2-432e-9848-b8787876b9d7 is already attached to instances: 36e3493f-fd10-45d6-bc85-4456db192b87 Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:40.898889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3a3eece2-3ff2-432e-9848-b8787876b9d7 is already attached to instances: 36e3493f-fd10-45d6-bc85-4456db192b87 Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:40.900316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3a3eece2-3ff2-432e-9848-b8787876b9d7 is already attached to instances: 36e3493f-fd10-45d6-bc85-4456db192b87 Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 400 to user: Invalid volume: volume 3a3eece2-3ff2-432e-9848-b8787876b9d7 is already attached to instances: 36e3493f-fd10-45d6-bc85-4456db192b87 {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-885adb0a-dfe2-4ad2-b8a0-420b78a6b231 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119684 Sep 08 20:02:40.901834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 398/833] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:02:40 2022] POST /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:02:40.977136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:40.977970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:40.988032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:40.988847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:40.989435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:40.990479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:40.991156 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:40.991730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:41.097214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lazy-loading 'services' on Instance uuid 36e3493f-fd10-45d6-bc85-4456db192b87 {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:02:41.193807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cb2f1bd5-5e1d-4309-83a0-3e85460ac759 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments/3a3eece2-3ff2-432e-9848-b8787876b9d7" status: 202 len: 0 microversion: 2.1 time: 0.220410 Sep 08 20:02:41.197560 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 436/834] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:02:40 2022] DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments/3a3eece2-3ff2-432e-9848-b8787876b9d7 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:02:41.203075 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:41.206220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:41.213522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:41.214076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:41.214518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:41.215274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:41.215729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:41.216185 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:41.222052 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:41.260203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-95101d07-f9d2-47c7-a367-8b69a3cbcc90 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061133 Sep 08 20:02:41.261063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 399/835] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:02:41 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:41.768493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-550169817", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90750b96-72bd-43c4-9fad-72ba52340af3"}], "security_groups": [{"name": "tempest-securitygroup--1776985333"}], "key_name": "tempest-keypair-268392082", "user_data": "}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:41.879026 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] validate_networks() for [('90750b96-72bd-43c4-9fad-72ba52340af3', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:02:42.273296 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:42.275785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:42.283224 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.283849 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.284350 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.285113 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.285682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.286174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.317649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f27b1be0-8871-4394-8505-7bc0b50ceaa8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048347 Sep 08 20:02:42.318557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 400/836] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:02:42 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:02:42.391834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:42.392366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:42.398991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.399485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.400169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.400878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.401336 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.401756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.428799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:02:42.513651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bd98fc20-ae7e-4916-b157-45bc5dd4aec9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 204 len: 0 microversion: 2.1 time: 0.127117 Sep 08 20:02:42.519316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 401/837] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:02:42 2022] DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:02:42.525653 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:42.526266 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:42.532618 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.533102 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.533525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.534402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.534873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.535474 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.542060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:02:42.542546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:02:42.543157 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:02:42.543622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:02:42.544129 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:02:42.555034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.555884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.556376 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.557162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:42.557959 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:42.558680 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:42.599445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for project 5600d866afb84f53882c2a5fb07298b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:02:42.603631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for user e582f450b96c4e37ad88501bfa02441e and project 5600d866afb84f53882c2a5fb07298b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:02:42.624527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:02:42.627075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:02:42.687830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:42.697766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3a2ee5e0-ba1b-4378-99bb-214d05720020 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1677 microversion: 2.1 time: 0.176767 Sep 08 20:02:42.713973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 402/838] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:42 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:42.736995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4fae841a-842b-4f2a-8042-2abdf2f5b94f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.973439 Sep 08 20:02:42.738588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 437/839] 10.222.0.44 () {62 vars in 1188 bytes} [Thu Sep 8 20:02:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 20:02:42.751942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2cfcc96e-05ca-4e8f-9e5e-8aa009eee495 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:42.752922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2cfcc96e-05ca-4e8f-9e5e-8aa009eee495 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:42.832930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2cfcc96e-05ca-4e8f-9e5e-8aa009eee495 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:42.842237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2cfcc96e-05ca-4e8f-9e5e-8aa009eee495 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:42.843700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2cfcc96e-05ca-4e8f-9e5e-8aa009eee495 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:42.844862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2cfcc96e-05ca-4e8f-9e5e-8aa009eee495 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1280 microversion: 2.20 time: 0.099202 Sep 08 20:02:42.845768 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 403/840] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:42 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1280 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 20:02:43.722422 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:43.723382 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:43.730472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:43.731003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:43.731435 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:43.732186 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:43.732639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:43.733062 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:43.869727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:43.870445 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:43.881050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:43.884700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:43.885241 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:43.885712 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:43.886425 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:43.887043 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:43.887669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:43.889855 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4a78bc38-d265-4d5d-b0e7-590994c751b1 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1677 microversion: 2.1 time: 0.172208 Sep 08 20:02:43.895292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 438/841] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:43 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:43.956476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:43.965191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:43.966878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:43.968787 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0a208a00-2a58-4d32-9fd9-4c1f4ec3f34f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1276 microversion: 2.20 time: 0.103366 Sep 08 20:02:43.969342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 404/842] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:43 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:44.917507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:44.918209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:44.924831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:44.925364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:44.925758 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:44.926484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:44.926954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:44.927377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:44.993646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:44.994255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:45.001295 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:45.001777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:45.002209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:45.002932 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:45.003386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:45.003809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:45.066609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:45.075008 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:45.076436 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:45.077583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-94916022-7802-4f2a-a0a2-530a5f9e6a94 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1338 microversion: 2.20 time: 0.087967 Sep 08 20:02:45.078144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 405/843] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:44 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 20:02:45.238548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:45.247860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-14e0276f-e9e3-4177-89aa-60bbff677e42 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1677 microversion: 2.1 time: 0.334225 Sep 08 20:02:45.248436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 439/844] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:44 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1677 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:45.951204 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-07efc6e0-1797-4f3f-950e-3f74e0e840aa req-d64ae21c-3765-49ec-a74e-a29f4ddc5f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e3493f-fd10-45d6-bc85-4456db192b87", "name": "network-vif-deleted", "tag": "a85c575e-ffe4-4267-baa8-6666a568dd35"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:45.960840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-07efc6e0-1797-4f3f-950e-3f74e0e840aa req-d64ae21c-3765-49ec-a74e-a29f4ddc5f25 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:45.961318 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-07efc6e0-1797-4f3f-950e-3f74e0e840aa req-d64ae21c-3765-49ec-a74e-a29f4ddc5f25 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:45.961922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-07efc6e0-1797-4f3f-950e-3f74e0e840aa req-d64ae21c-3765-49ec-a74e-a29f4ddc5f25 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:45.975167 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-07efc6e0-1797-4f3f-950e-3f74e0e840aa req-d64ae21c-3765-49ec-a74e-a29f4ddc5f25 service nova] Creating event network-vif-deleted:a85c575e-ffe4-4267-baa8-6666a568dd35 for instance 36e3493f-fd10-45d6-bc85-4456db192b87 on hv-cinder-83124 Sep 08 20:02:45.980315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-07efc6e0-1797-4f3f-950e-3f74e0e840aa req-d64ae21c-3765-49ec-a74e-a29f4ddc5f25 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032812 Sep 08 20:02:45.980907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 406/845] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:46.103446 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:46.104432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:46.111438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:46.111932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:46.112369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:46.113316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:46.113685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:46.114116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:46.276320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:46.278345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:46.280522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=3 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:46.285998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:46.286607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:46.287328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:46.288109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:46.288676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:46.289203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:46.326252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:46.326924 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:46.327457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:46.328023 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lazy-loading 'fault' on Instance uuid 36e3493f-fd10-45d6-bc85-4456db192b87 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:02:46.374337 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:46.386729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2735f6eb-b38b-40fe-bab1-f5924bb546c2 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 200 len: 1328 microversion: 2.1 time: 0.119068 Sep 08 20:02:46.387557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 407/846] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:46 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:46.408111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:46.410610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:46.417838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:46.419406 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:46.420590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2497c7ca-fc7e-4e80-86a0-142c48a2c5f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.322728 Sep 08 20:02:46.421393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 440/847] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:46 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:47.409675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:47.410259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:47.416999 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:47.417482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:47.417905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:47.418597 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:47.419078 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:47.419520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:47.433386 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 HTTP/1.1 Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:02:47.435115 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:02:47.436540 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '36e3493f-fd10-45d6-bc85-4456db192b87'} Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:02:47.437278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:02:47.438479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:02:47.439684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:02:47.439684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-94f1f4cf-face-4354-bcb3-a30501c0d5d8 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 404 len: 111 microversion: 2.1 time: 0.030874 Sep 08 20:02:47.439684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 408/848] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:47 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:02:47.445427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-619ae7fa-7fc4-4f78-a0cc-687f14ce2033 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '.version_select at 0x7fef84d788b0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:47.445819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:47.446506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:47.449232 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:47.456533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:47.459717 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:47.460278 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:47.461125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:47.461630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:47.462102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:47.465965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-619ae7fa-7fc4-4f78-a0cc-687f14ce2033 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-28852618" status: 202 len: 0 microversion: 2.1 time: 0.024193 Sep 08 20:02:47.466770 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 409/849] 10.222.0.44 () {58 vars in 1215 bytes} [Thu Sep 8 20:02:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-28852618 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:02:47.599324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:47.608499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:47.609936 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:47.611120 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-91f96fd5-78b4-40c3-8f83-0fe80a132cf1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.169360 Sep 08 20:02:47.618099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 441/850] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:47 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:48.005361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-306bdba2-90aa-4913-b048-0ea24320d8d8 req-348289aa-a042-40aa-9078-864cbf9bcbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:48.015727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-306bdba2-90aa-4913-b048-0ea24320d8d8 req-348289aa-a042-40aa-9078-864cbf9bcbe9 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:48.016200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-306bdba2-90aa-4913-b048-0ea24320d8d8 req-348289aa-a042-40aa-9078-864cbf9bcbe9 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:48.016619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-306bdba2-90aa-4913-b048-0ea24320d8d8 req-348289aa-a042-40aa-9078-864cbf9bcbe9 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:48.028430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-306bdba2-90aa-4913-b048-0ea24320d8d8 req-348289aa-a042-40aa-9078-864cbf9bcbe9 service nova] Creating event network-changed:0f999fed-be11-407f-ae8e-d916dbc59b56 for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 on hv-cinder-83124 Sep 08 20:02:48.033494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-306bdba2-90aa-4913-b048-0ea24320d8d8 req-348289aa-a042-40aa-9078-864cbf9bcbe9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033758 Sep 08 20:02:48.034080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 410/851] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:48.080611 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7fc9b73c-75d9-43cd-87ac-e3a301ea5c1f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: .version_select at 0x7fef84be8a60>, body: {"keypair": {"name": "tempest-keypair-734651046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmL8zZ3E6/hkPERZtcUxOY2KQNGL90rYOyj5NwrCBkXEyvDQ/hojn1UJWedDK0NgisXtqM+T03OskGexjImCbJqe1Xq0KRfVVU7ccf3qtfbzrg1uLC0vjBdC7EFsiDMOA=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:48.096389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7fc9b73c-75d9-43cd-87ac-e3a301ea5c1f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:02:48.100112 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7fc9b73c-75d9-43cd-87ac-e3a301ea5c1f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:02:48.126069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7fc9b73c-75d9-43cd-87ac-e3a301ea5c1f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049543 Sep 08 20:02:48.126669 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 442/852] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 20:02:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:48.637874 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:48.638593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:48.645778 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:48.646297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:48.646736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:48.647838 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:48.647962 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:48.648317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:48.778220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:48.786673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:48.788169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:48.789280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bfa735ca-0ce2-45a7-b8ce-8f2470304a9b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.155887 Sep 08 20:02:48.789811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 411/853] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:48 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:49.408087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-193967078", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e992bb3-3c6d-436c-8011-0fb47db3a78e"}], "security_groups": [{"name": "tempest-securitygroup--1132406690"}], "key_name": "tempest-keypair-734651046", "user_data": "}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:49.511193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] validate_networks() for [('9e992bb3-3c6d-436c-8011-0fb47db3a78e', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:02:49.813808 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:49.815544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:49.822998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:49.823632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:49.824186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:49.825026 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:49.825576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:49.826100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:49.970950 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:49.980062 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:49.981760 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:49.984103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6b322e02-31f5-4d61-a57a-1f2a201cab1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.173752 Sep 08 20:02:49.990683 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 412/854] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:49 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:50.421377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:02:50.422101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:02:50.422563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:02:50.423174 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:02:50.423651 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:02:50.433069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:50.433700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:50.434342 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:50.435449 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:50.436233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:50.436655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:50.454455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:02:50.458486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Getting quotas for user b7e4a99cc6454715aa37ab5674d095d6 and project 32ecb482bb59452cae7dcaf0fa882a7a. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:02:50.469554 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:02:50.471873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:02:50.520715 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0bb42ab4-f9ad-4800-ae2f-88c1d4060468 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.117559 Sep 08 20:02:50.521366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 443/855] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 20:02:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 20:02:50.533764 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e395e64a-94af-4fd7-9b36-555a5779911b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:50.534379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e395e64a-94af-4fd7-9b36-555a5779911b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:50.594798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e395e64a-94af-4fd7-9b36-555a5779911b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:50.601952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e395e64a-94af-4fd7-9b36-555a5779911b tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1240 microversion: 2.1 time: 0.073024 Sep 08 20:02:50.602530 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 413/856] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:50 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:51.009352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:51.009957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:51.017395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:51.017882 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:51.018311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:51.019042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:51.019490 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:51.019912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:51.156022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:51.164393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:51.165873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:51.167011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5b8e9c26-28da-43b6-a084-30667746fb89 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.161768 Sep 08 20:02:51.167573 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 444/857] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:51 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:51.625861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:51.626553 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:51.636237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:51.637336 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:51.637977 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:51.639104 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:51.640148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:51.640901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:51.713841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:51.722826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d3563703-d09f-43a4-9fa6-a22dc88c1038 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1300 microversion: 2.1 time: 0.101712 Sep 08 20:02:51.723404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 414/858] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:51 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:51.951454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-18c839aa-bc59-498b-b5a1-3a765812a88e req-bbb5a5d9-ad5b-468f-ab0b-9c9f30c17a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "name": "network-vif-plugged", "status": "completed", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:51.961653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-18c839aa-bc59-498b-b5a1-3a765812a88e req-bbb5a5d9-ad5b-468f-ab0b-9c9f30c17a9f service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:51.962118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-18c839aa-bc59-498b-b5a1-3a765812a88e req-bbb5a5d9-ad5b-468f-ab0b-9c9f30c17a9f service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:51.962582 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-18c839aa-bc59-498b-b5a1-3a765812a88e req-bbb5a5d9-ad5b-468f-ab0b-9c9f30c17a9f service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:51.979235 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-18c839aa-bc59-498b-b5a1-3a765812a88e req-bbb5a5d9-ad5b-468f-ab0b-9c9f30c17a9f service nova] Creating event network-vif-plugged:0f999fed-be11-407f-ae8e-d916dbc59b56 for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 on hv-cinder-83124 Sep 08 20:02:51.984679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-18c839aa-bc59-498b-b5a1-3a765812a88e req-bbb5a5d9-ad5b-468f-ab0b-9c9f30c17a9f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036857 Sep 08 20:02:51.985306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 445/859] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:02:52.191259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:52.191928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:52.198096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:52.198856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:52.199286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:52.199988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:52.200436 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:52.200856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:52.337313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:52.345396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:52.346848 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:52.347956 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8ce705ca-4b01-4fff-b6e5-f91b07e51e20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.160963 Sep 08 20:02:52.362682 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 415/860] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:52 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:52.746444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:52.747170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:52.753835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:52.754294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:52.755105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:52.755801 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:52.756292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:52.756747 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:52.959382 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:52.969280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6d863159-2554-4223-b5a4-836af68cabe0 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1366 microversion: 2.1 time: 0.227422 Sep 08 20:02:52.969896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 446/861] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:52 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:53.339033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-88202a16-a4aa-4ba6-95e7-747a85e95c1d req-849ac5e6-18fa-4a81-b001-ed2314df1b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4988530-1ef8-47e1-b0f6-9feb057efa56", "tag": "f4f54f2b-3784-494a-bb0d-31bd0714b695"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:53.349611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-88202a16-a4aa-4ba6-95e7-747a85e95c1d req-849ac5e6-18fa-4a81-b001-ed2314df1b48 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:53.350129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-88202a16-a4aa-4ba6-95e7-747a85e95c1d req-849ac5e6-18fa-4a81-b001-ed2314df1b48 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:53.350576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-88202a16-a4aa-4ba6-95e7-747a85e95c1d req-849ac5e6-18fa-4a81-b001-ed2314df1b48 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:53.362312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-88202a16-a4aa-4ba6-95e7-747a85e95c1d req-849ac5e6-18fa-4a81-b001-ed2314df1b48 service nova] Creating event network-changed:f4f54f2b-3784-494a-bb0d-31bd0714b695 for instance f4988530-1ef8-47e1-b0f6-9feb057efa56 on hv-cinder-83124 Sep 08 20:02:53.367504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-88202a16-a4aa-4ba6-95e7-747a85e95c1d req-849ac5e6-18fa-4a81-b001-ed2314df1b48 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032260 Sep 08 20:02:53.368696 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 416/862] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:02:53.374444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:53.375138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:53.381773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:53.382345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:53.382930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:53.383735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:53.384241 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:53.384715 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:53.562283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:53.571675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:53.573103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:53.574219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-27ca7bb8-cf51-49d2-9bf2-42d53ba6d340 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1406 microversion: 2.20 time: 0.204359 Sep 08 20:02:53.574782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 447/863] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:53 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:53.992968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:53.994040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:54.001840 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:54.002335 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:54.003006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:54.003694 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:54.004544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:54.004984 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:54.142479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:54.150689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d47c3efc-8f25-455b-9896-7805541d24be tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1366 microversion: 2.1 time: 0.162251 Sep 08 20:02:54.151441 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 417/864] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:53 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:54.606967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:54.607618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:54.614768 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:54.615263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:54.615701 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:54.616402 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:54.616856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:54.617285 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:54.749316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:54.757847 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:54.759312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:54.760481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c2bd4445-784b-4323-8612-e7a7eb9368e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1597 microversion: 2.20 time: 0.157575 Sep 08 20:02:54.761050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 448/865] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:02:54 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:02:54.784739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:54.785214 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:54.791882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:54.792373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:54.792807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:54.793498 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:54.793956 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:54.794377 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:54.872817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bc99f705-b356-4169-b02e-879ac553fdf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091945 Sep 08 20:02:54.873419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 418/866] 10.222.0.44 () {60 vars in 1316 bytes} [Thu Sep 8 20:02:54 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:02:55.173939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:55.174453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:55.180755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:55.181265 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:55.181692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:55.182392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:55.182875 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:55.183299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:55.314610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:55.322798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f17feeb9-b5f0-4f59-943a-cae0e58c7e0d tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1366 microversion: 2.1 time: 0.152750 Sep 08 20:02:55.323485 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 449/867] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:55 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:55.832632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-d834ed72-35ad-47b2-9b68-57cf1c7c0a91 req-633e8c26-4eaa-470d-a8f8-798e565c8914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:55.842451 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d834ed72-35ad-47b2-9b68-57cf1c7c0a91 req-633e8c26-4eaa-470d-a8f8-798e565c8914 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:55.843032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d834ed72-35ad-47b2-9b68-57cf1c7c0a91 req-633e8c26-4eaa-470d-a8f8-798e565c8914 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:55.843526 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-d834ed72-35ad-47b2-9b68-57cf1c7c0a91 req-633e8c26-4eaa-470d-a8f8-798e565c8914 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:55.855806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-d834ed72-35ad-47b2-9b68-57cf1c7c0a91 req-633e8c26-4eaa-470d-a8f8-798e565c8914 service nova] Creating event network-changed:0f999fed-be11-407f-ae8e-d916dbc59b56 for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 on hv-cinder-83124 Sep 08 20:02:55.861051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-d834ed72-35ad-47b2-9b68-57cf1c7c0a91 req-633e8c26-4eaa-470d-a8f8-798e565c8914 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032655 Sep 08 20:02:55.861788 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 419/868] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:56.346250 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:56.347338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:56.354697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:56.355483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:56.355969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:56.358149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:56.358848 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:56.359459 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:56.651574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:56.659452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c0021fbf-722e-4784-b2ad-9dbcf542939c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1366 microversion: 2.1 time: 0.317789 Sep 08 20:02:56.674736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 450/869] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:56 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1366 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:57.688252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:57.689744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:57.700427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:57.701276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:57.702001 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:57.703204 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:57.703930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:57.704691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:57.727118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:02:57.845398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:57.853656 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bce2f506-0318-4271-9b5c-fafe056ebb0e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1366 microversion: 2.1 time: 0.173467 Sep 08 20:02:57.854202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 420/870] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:57 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:02:57.989588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-f2e77812-c3ea-4dfc-8243-aa3dd7059c03 req-c57c2496-8dc5-4b89-ba71-54c8ad7fd138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4988530-1ef8-47e1-b0f6-9feb057efa56", "name": "network-vif-plugged", "status": "completed", "tag": "f4f54f2b-3784-494a-bb0d-31bd0714b695"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:02:58.001686 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-f2e77812-c3ea-4dfc-8243-aa3dd7059c03 req-c57c2496-8dc5-4b89-ba71-54c8ad7fd138 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:58.002227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-f2e77812-c3ea-4dfc-8243-aa3dd7059c03 req-c57c2496-8dc5-4b89-ba71-54c8ad7fd138 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:58.002707 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-f2e77812-c3ea-4dfc-8243-aa3dd7059c03 req-c57c2496-8dc5-4b89-ba71-54c8ad7fd138 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:58.013888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-f2e77812-c3ea-4dfc-8243-aa3dd7059c03 req-c57c2496-8dc5-4b89-ba71-54c8ad7fd138 service nova] Creating event network-vif-plugged:f4f54f2b-3784-494a-bb0d-31bd0714b695 for instance f4988530-1ef8-47e1-b0f6-9feb057efa56 on hv-cinder-83124 Sep 08 20:02:58.018835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-f2e77812-c3ea-4dfc-8243-aa3dd7059c03 req-c57c2496-8dc5-4b89-ba71-54c8ad7fd138 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032968 Sep 08 20:02:58.019462 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 451/871] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:02:58.880630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:02:58.881480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:02:58.892503 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:58.893311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:58.894069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:58.895306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:02:58.896070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:02:58.896777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:02:59.028908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:02:59.037153 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6bff3ce7-d3d2-4488-80b0-95567fa7310e tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1366 microversion: 2.1 time: 0.163447 Sep 08 20:02:59.037725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 421/872] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:02:58 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:00.060686 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:00.061284 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:00.067669 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:00.068133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:00.068581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:00.069398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:00.069849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:00.070362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:00.205502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:00.213856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b47028b1-3a39-4dd7-bcbb-caeb571399d5 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1555 microversion: 2.1 time: 0.158080 Sep 08 20:03:00.214418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 452/873] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:00 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:00.236525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:00.237056 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:00.243674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:00.244147 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:00.244574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:00.245278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:00.246064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:00.246481 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:00.339734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2295e64e-a26c-487b-9d0d-7699905099a3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106762 Sep 08 20:03:00.340549 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 422/874] 10.222.0.44 () {58 vars in 1275 bytes} [Thu Sep 8 20:03:00 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:01.287578 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-54ead0e4-1fb0-4fa2-8739-f9a771be2c44 req-6ba1a9e0-9cef-47ed-bc73-5f12e7140c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4988530-1ef8-47e1-b0f6-9feb057efa56", "tag": "f4f54f2b-3784-494a-bb0d-31bd0714b695"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:03:01.292770 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:01.294374 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=20 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:01.301167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-54ead0e4-1fb0-4fa2-8739-f9a771be2c44 req-6ba1a9e0-9cef-47ed-bc73-5f12e7140c9b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:01.301650 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-54ead0e4-1fb0-4fa2-8739-f9a771be2c44 req-6ba1a9e0-9cef-47ed-bc73-5f12e7140c9b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:01.302080 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-54ead0e4-1fb0-4fa2-8739-f9a771be2c44 req-6ba1a9e0-9cef-47ed-bc73-5f12e7140c9b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:01.313067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-54ead0e4-1fb0-4fa2-8739-f9a771be2c44 req-6ba1a9e0-9cef-47ed-bc73-5f12e7140c9b service nova] Creating event network-changed:f4f54f2b-3784-494a-bb0d-31bd0714b695 for instance f4988530-1ef8-47e1-b0f6-9feb057efa56 on hv-cinder-83124 Sep 08 20:03:01.317928 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-54ead0e4-1fb0-4fa2-8739-f9a771be2c44 req-6ba1a9e0-9cef-47ed-bc73-5f12e7140c9b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034138 Sep 08 20:03:01.318562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 453/875] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:04.964837 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:04.970036 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-703bfa33-3183-4ed7-bb1f-8e3ff70ed36f req-2ed75698-8bb9-4e7b-82a5-837e5dba774b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:03:04.970513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:04.970911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:04.977565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:04.978119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:04.978611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:04.979439 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:04.980109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:04.980483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-703bfa33-3183-4ed7-bb1f-8e3ff70ed36f req-2ed75698-8bb9-4e7b-82a5-837e5dba774b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:04.980603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:04.980954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-703bfa33-3183-4ed7-bb1f-8e3ff70ed36f req-2ed75698-8bb9-4e7b-82a5-837e5dba774b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:04.981597 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-703bfa33-3183-4ed7-bb1f-8e3ff70ed36f req-2ed75698-8bb9-4e7b-82a5-837e5dba774b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:04.995428 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-703bfa33-3183-4ed7-bb1f-8e3ff70ed36f req-2ed75698-8bb9-4e7b-82a5-837e5dba774b service nova] Creating event network-changed:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 20:03:05.001017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-703bfa33-3183-4ed7-bb1f-8e3ff70ed36f req-2ed75698-8bb9-4e7b-82a5-837e5dba774b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034862 Sep 08 20:03:05.001592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 454/876] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:05.009803 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:03:05.097304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-73827ddd-16d3-4a86-8efe-d0ab38ec09fc tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 204 len: 0 microversion: 2.1 time: 0.133118 Sep 08 20:03:05.098295 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 423/877] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:03:04 2022] DELETE /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:03:05.106869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:05.107571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:05.113824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:05.114309 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:05.114765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:05.115458 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:05.115908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:05.116324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:05.282423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:05.292558 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0a813f42-eb64-4bad-bb88-8f3108a9382b tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.189569 Sep 08 20:03:05.293429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 455/878] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:05 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:06.319666 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:06.320512 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:06.328536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:06.329120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:06.329601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:06.330440 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:06.331140 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:06.331680 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:06.472013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:06.486874 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-bc187cf7-0fdb-4efa-a896-94b8af3b139c tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1570 microversion: 2.1 time: 0.172775 Sep 08 20:03:06.487431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 424/879] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:06 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:07.512575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:07.513280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:07.520419 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:07.520908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:07.521347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:07.522041 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:07.522496 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:07.522951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:07.744923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6e67be2d33406fb8fb23674f9aa679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffecc3e1b5c04268a904802a752ef7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:07.754863 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-9b2d8583-916a-47f5-982d-c97adb17e597 req-ea8b2f4f-f55f-426e-b692-bcbf284448e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe38b93c-1307-4796-b320-67b6b3465e9d", "name": "network-vif-deleted", "tag": "50f46fb9-6be3-4b6e-91ab-7cb09a400af4"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:03:07.755784 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8d5702e8-7fc0-4c90-b326-fe0e39abec78 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 200 len: 1451 microversion: 2.1 time: 0.246309 Sep 08 20:03:07.757619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 456/880] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:07 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 1451 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:07.764810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-9b2d8583-916a-47f5-982d-c97adb17e597 req-ea8b2f4f-f55f-426e-b692-bcbf284448e0 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:07.765284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-9b2d8583-916a-47f5-982d-c97adb17e597 req-ea8b2f4f-f55f-426e-b692-bcbf284448e0 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:07.765714 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-9b2d8583-916a-47f5-982d-c97adb17e597 req-ea8b2f4f-f55f-426e-b692-bcbf284448e0 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:07.779244 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-9b2d8583-916a-47f5-982d-c97adb17e597 req-ea8b2f4f-f55f-426e-b692-bcbf284448e0 service nova] Creating event network-vif-deleted:50f46fb9-6be3-4b6e-91ab-7cb09a400af4 for instance fe38b93c-1307-4796-b320-67b6b3465e9d on hv-cinder-83124 Sep 08 20:03:07.784358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-9b2d8583-916a-47f5-982d-c97adb17e597 req-ea8b2f4f-f55f-426e-b692-bcbf284448e0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Sep 08 20:03:07.785174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 425/881] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:03:08.779648 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:08.780401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] [instance: fe38b93c-1307-4796-b320-67b6b3465e9d] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:08.787925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:08.788437 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:08.788974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:08.789789 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:08.790374 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:08.790912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:08.805970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] HTTP exception thrown: Instance fe38b93c-1307-4796-b320-67b6b3465e9d could not be found. Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Request method failure captured: Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d HTTP/1.1 Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkjsSBYLqBQYeoZswhcUY4YRixTFdNqB16k--UhOQL5gUxA5-Z9cZ1c3PuzXr59ZeZRght5v3pw0825G0HR_1cqjmDvCtpbNMvdf6QymrNuSu0UjzuPxRp67Qm2YRZtwhkogm4vLVbkkqMM9iMn7BL-VE7X63drky20D2n28fK5evzs Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: ffecc3e1b5c04268a904802a752ef7f5 Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-TestShelveInstance-554215657 Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:03:08.807580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ffecc3e1b5c04268a904802a752ef7f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ffecc3e1b5c04268a904802a752ef7f5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ffecc3e1b5c04268a904802a752ef7f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ffecc3e1b5c04268a904802a752ef7f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-TestShelveInstance-554215657 Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: ffecc3e1b5c04268a904802a752ef7f5 Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-TestShelveInstance-554215657 Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-TestShelveInstance-554215657-project Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: fc6e67be2d33406fb8fb23674f9aa679 Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-TestShelveInstance-554215657-project Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance fe38b93c-1307-4796-b320-67b6b3465e9d could not be found. Sep 08 20:03:08.809237 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'fe38b93c-1307-4796-b320-67b6b3465e9d'} Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe38b93c-1307-4796-b320-67b6b3465e9d could not be found. Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:03:08.810071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe38b93c-1307-4796-b320-67b6b3465e9d could not be found. Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe38b93c-1307-4796-b320-67b6b3465e9d could not be found. Sep 08 20:03:08.811417 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:08.812661 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Returning 404 to user: Instance fe38b93c-1307-4796-b320-67b6b3465e9d could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:03:08.812661 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-860f57ce-20a7-41ac-bc68-7a97a3393f66 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d" status: 404 len: 111 microversion: 2.1 time: 0.033687 Sep 08 20:03:08.812661 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 457/882] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:08 2022] GET /compute/v2.1/servers/fe38b93c-1307-4796-b320-67b6b3465e9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:03:08.975406 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-195c08f4-756b-4f54-bd3e-9ae5486f94d8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] Calling method '.version_select at 0x7fef84d78820>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:09.000109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-195c08f4-756b-4f54-bd3e-9ae5486f94d8 tempest-TestShelveInstance-554215657 tempest-TestShelveInstance-554215657-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2141314357" status: 202 len: 0 microversion: 2.1 time: 0.029442 Sep 08 20:03:09.000621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 426/883] 10.222.0.44 () {58 vars in 1254 bytes} [Thu Sep 8 20:03:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2141314357 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:03:09.642059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:09.642556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:09.651191 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:09.651677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:09.652092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:09.653021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:09.653468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:09.653867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:09.682038 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9d1749ab-f5a2-45da-93d6-6433e4f366e4 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/ips" status: 200 len: 145 microversion: 2.1 time: 0.043961 Sep 08 20:03:09.689074 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 458/884] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 20:03:09 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:11.052543 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "143e39ad-600a-42ef-979d-d3a617800c3e"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:03:11.055028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:11.061891 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:11.062379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:11.062851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:11.063550 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:11.064010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:11.064438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:11.351833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c6185f62-ff4a-411b-96c4-13c724423329 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303617 Sep 08 20:03:11.352827 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 427/885] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:03:11 2022] POST /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:18.949203 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:18.951517 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:18.953877 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:18.959349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:18.959840 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:18.960283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:18.961025 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:18.961476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:18.961902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:18.965117 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=78 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:18.993307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-41a985ef-60a1-4114-83fe-688d0c81bb72 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048035 Sep 08 20:03:18.993862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 459/886] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:03:18 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:19.006551 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:19.007137 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:19.009124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:19.014905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:19.015395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:19.015836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:19.016534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:19.016981 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:19.017414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:19.048186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-20edbfc5-7e3d-453f-bf75-0c690891ac91 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/143e39ad-600a-42ef-979d-d3a617800c3e" status: 200 len: 194 microversion: 2.1 time: 0.046745 Sep 08 20:03:19.048755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 428/887] 10.222.0.44 () {58 vars in 1413 bytes} [Thu Sep 8 20:03:19 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/143e39ad-600a-42ef-979d-d3a617800c3e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:20.409585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d583fe6-c404-46af-9420-df31ac13a03f"}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:03:20.411957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:20.418903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:20.419393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:20.419817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:20.420518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:20.420975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:20.421407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:20.689866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-dbc72731-fe83-4ae8-9f94-975aebc595ca tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "POST /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283757 Sep 08 20:03:20.690477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 460/888] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:03:20 2022] POST /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:28.305325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:28.308243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:28.314990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:28.315469 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:28.315904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:28.316598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:28.317053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:28.317471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:28.319922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:03:28.349748 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-673e6a3a-b252-49bf-8766-4e1339502581 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048409 Sep 08 20:03:28.350347 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 429/889] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:03:28 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:28.498390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:28.499008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:28.506339 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:28.506856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:28.507286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:28.507974 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:28.508475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:28.508878 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:28.538486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6d74739f-c44c-472b-bfb9-b4b1f82625ed tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/143e39ad-600a-42ef-979d-d3a617800c3e" status: 200 len: 194 microversion: 2.1 time: 0.046244 Sep 08 20:03:28.539091 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 461/890] 10.222.0.44 () {58 vars in 1413 bytes} [Thu Sep 8 20:03:28 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/143e39ad-600a-42ef-979d-d3a617800c3e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:28.549755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:28.550249 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:28.556424 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:28.556914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:28.557354 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:28.558124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:28.558586 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:28.559040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:28.643039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lazy-loading 'services' on Instance uuid c0bc412d-e701-4c39-832e-3c9c41b09d66 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:03:28.720775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e8ee13c0-0e1d-446a-ac6b-da0297736f76 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/143e39ad-600a-42ef-979d-d3a617800c3e" status: 202 len: 0 microversion: 2.1 time: 0.174926 Sep 08 20:03:28.721366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 430/891] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:03:28 2022] DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/143e39ad-600a-42ef-979d-d3a617800c3e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:03:29.847815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:29.848329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:29.855281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:29.855811 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:29.856246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:29.856941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:29.857379 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:29.857797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:29.887588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c67f1861-d53e-4b5f-948c-bc33d36219e6 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/8d583fe6-c404-46af-9420-df31ac13a03f" status: 200 len: 194 microversion: 2.1 time: 0.043708 Sep 08 20:03:29.888152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 462/892] 10.222.0.44 () {58 vars in 1413 bytes} [Thu Sep 8 20:03:29 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/8d583fe6-c404-46af-9420-df31ac13a03f => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:29.899660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:29.900234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:29.907245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:29.907723 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:29.908146 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:29.908831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:29.909275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:29.909689 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:30.008020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lazy-loading 'services' on Instance uuid c0bc412d-e701-4c39-832e-3c9c41b09d66 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:03:30.095947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-95c41977-7c38-4fe9-9ccf-f490435b4b39 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/8d583fe6-c404-46af-9420-df31ac13a03f" status: 202 len: 0 microversion: 2.1 time: 0.200376 Sep 08 20:03:30.096529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 431/893] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:03:29 2022] DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments/8d583fe6-c404-46af-9420-df31ac13a03f => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 20:03:31.291514 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:31.293766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:31.300701 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.301187 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.301624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.302310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.302805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.303229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.333893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8956e884-681c-4c05-afa0-02c7aadb9984 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046349 Sep 08 20:03:31.334455 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 463/894] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:03:31 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:03:31.456361 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:31.458851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:31.465166 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.465657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.466202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.466907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.467367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.467799 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.497285 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-27e54a12-c23b-4db5-bf43-e1f817f2e0d2 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045609 Sep 08 20:03:31.497863 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 432/895] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:03:31 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:03:31.562140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:31.562928 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:31.569108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.569595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.570277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.571151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.571641 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.572068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.597892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:03:31.676737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9f5c95a4-f02d-46f0-9ad9-b95bbff64cb7 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 204 len: 0 microversion: 2.1 time: 0.118276 Sep 08 20:03:31.677538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 464/896] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:03:31 2022] DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:03:31.686581 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:31.687229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:31.693909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.694384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.694841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.695526 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:31.695975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:31.696395 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:31.832748 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:31.840662 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c29e2908-4294-4a7f-b8bd-d6c9882416f5 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1674 microversion: 2.1 time: 0.158035 Sep 08 20:03:31.841231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 433/897] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:31 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:32.869231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:32.870264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:32.878610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:32.879132 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:32.879562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:32.880253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:32.880704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:32.881134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:33.014684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:33.023098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ccdef9a1-1380-4104-ad7d-5e2cf358c670 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1674 microversion: 2.1 time: 0.160962 Sep 08 20:03:33.023671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 465/898] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:32 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:34.045795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:34.046499 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:34.053346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:34.053833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:34.054264 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:34.054993 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:34.055430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:34.055861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:34.188375 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:34.196326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b9997f1e-67ae-43bc-a180-9943abe2fe74 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1674 microversion: 2.1 time: 0.154607 Sep 08 20:03:34.196905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 434/899] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:34 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:34.643824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-9a7f137f-a516-49e3-99e9-b9030ac41652 req-cddcd567-b921-4c2a-a2b5-5803ffe2f132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bc412d-e701-4c39-832e-3c9c41b09d66", "name": "network-vif-deleted", "tag": "4bf2756b-b7a5-4639-8b84-4b8b7068da2d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:03:34.658009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9a7f137f-a516-49e3-99e9-b9030ac41652 req-cddcd567-b921-4c2a-a2b5-5803ffe2f132 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:34.658486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9a7f137f-a516-49e3-99e9-b9030ac41652 req-cddcd567-b921-4c2a-a2b5-5803ffe2f132 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:34.658937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-9a7f137f-a516-49e3-99e9-b9030ac41652 req-cddcd567-b921-4c2a-a2b5-5803ffe2f132 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:34.671200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-9a7f137f-a516-49e3-99e9-b9030ac41652 req-cddcd567-b921-4c2a-a2b5-5803ffe2f132 service nova] Creating event network-vif-deleted:4bf2756b-b7a5-4639-8b84-4b8b7068da2d for instance c0bc412d-e701-4c39-832e-3c9c41b09d66 on hv-cinder-83124 Sep 08 20:03:34.676440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-9a7f137f-a516-49e3-99e9-b9030ac41652 req-cddcd567-b921-4c2a-a2b5-5803ffe2f132 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036388 Sep 08 20:03:34.677862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 466/900] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:03:35.220254 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:35.220864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:35.227733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:35.228304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:35.228830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:35.229601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:35.230130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:35.230621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:35.263899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:35.264535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:35.265005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:35.265721 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lazy-loading 'fault' on Instance uuid c0bc412d-e701-4c39-832e-3c9c41b09d66 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:03:35.307663 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14824e303e544aa6b206e0692f703e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f26f42f69c1b4f48b9a9746bfcc8fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:03:35.315101 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d3d29ce1-c413-4c69-a6eb-87886fbe3924 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 200 len: 1328 microversion: 2.1 time: 0.098789 Sep 08 20:03:35.315897 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 435/901] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:35 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:03:36.342964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:36.344113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:36.356332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:36.357126 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:36.357844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:36.359035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:36.359911 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:36.360362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:36.374504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] HTTP exception thrown: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Request method failure captured: Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 HTTP/1.1 Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhYmnU6HFeiZH7jDYCvoI_qI66fSKJ4MFwQTZzTfhSKAPU7g4XiMLXuUmgA7hvgn0LP05ClDvThfNzCS0DZUx2kc7hAy56bb7EP3DBr0kGLrbkVhX1j7xfLn1O0MChsriBhPeVuRNngQbOaU23lN6KiwrD9myX2S0dsxQ3Bb-S0T8w Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:03:36.376196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26f42f69c1b4f48b9a9746bfcc8fa5c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 14824e303e544aa6b206e0692f703e5a Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:36.377813 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'c0bc412d-e701-4c39-832e-3c9c41b09d66'} Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:03:36.378676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:36.380178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:36.381590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Returning 404 to user: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:03:36.381590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d05dbf91-d386-4841-93ad-54354dbc8001 tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 404 len: 111 microversion: 2.1 time: 0.041713 Sep 08 20:03:36.381590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 467/902] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:36 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:03:36.387005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6b522953-8f24-4793-8987-d4fc3f22cc0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '.version_select at 0x7fef84ae4e50>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:36.409332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6b522953-8f24-4793-8987-d4fc3f22cc0b tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118785364" status: 202 len: 0 microversion: 2.1 time: 0.026397 Sep 08 20:03:36.409911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 436/903] 10.222.0.44 () {58 vars in 1221 bytes} [Thu Sep 8 20:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118785364 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:03:39.371146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:39.371667 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:39.378319 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:39.378843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:39.379267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:39.379953 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:39.380401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:39.380819 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:39.394712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] HTTP exception thrown: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Request method failure captured: Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 HTTP/1.1 Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhYmnU6HFeiZH7jDYCvoI_qI66fSKJ4MFwQTZzTfhSKAPU7g4XiMLXuUmgA7hvgn0LP05ClDvThfNzCS0DZUx2kc7hAy56bb7EP3DBr0kGLrbkVhX1j7xfLn1O0MChsriBhPeVuRNngQbOaU23lN6KiwrD9myX2S0dsxQ3Bb-S0T8w Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:03:39.396253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26f42f69c1b4f48b9a9746bfcc8fa5c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 14824e303e544aa6b206e0692f703e5a Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.397762 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'c0bc412d-e701-4c39-832e-3c9c41b09d66'} Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:03:39.398724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.400043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.401672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Returning 404 to user: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:03:39.401672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7669e750-5a9e-41a5-8bf1-a6ae0275422d tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 404 len: 111 microversion: 2.1 time: 0.030742 Sep 08 20:03:39.401672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 468/904] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:03:39 2022] DELETE /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:03:39.409534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:39.410275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c0bc412d-e701-4c39-832e-3c9c41b09d66] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:39.421134 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:39.421831 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:39.422505 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:39.423678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:39.424198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:39.424706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:39.438250 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] HTTP exception thrown: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Request method failure captured: Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 HTTP/1.1 Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhYmnU6HFeiZH7jDYCvoI_qI66fSKJ4MFwQTZzTfhSKAPU7g4XiMLXuUmgA7hvgn0LP05ClDvThfNzCS0DZUx2kc7hAy56bb7EP3DBr0kGLrbkVhX1j7xfLn1O0MChsriBhPeVuRNngQbOaU23lN6KiwrD9myX2S0dsxQ3Bb-S0T8w Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:03:39.439973 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26f42f69c1b4f48b9a9746bfcc8fa5c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 14824e303e544aa6b206e0692f703e5a Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.441565 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'c0bc412d-e701-4c39-832e-3c9c41b09d66'} Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:03:39.442623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. Sep 08 20:03:39.444229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:39.445637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Returning 404 to user: Instance c0bc412d-e701-4c39-832e-3c9c41b09d66 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:03:39.445637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6c535c76-2eaa-4d52-8468-6af84c88799e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66" status: 404 len: 111 microversion: 2.1 time: 0.039075 Sep 08 20:03:39.445637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 437/905] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:39 2022] GET /compute/v2.1/servers/c0bc412d-e701-4c39-832e-3c9c41b09d66 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:03:40.602495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:40.602997 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:40.609752 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:40.610260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:40.610702 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:40.611456 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:40.611910 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:40.612333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:40.626386 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] HTTP exception thrown: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Request method failure captured: Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f HTTP/1.1 Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhYmnU6HFeiZH7jDYCvoI_qI66fSKJ4MFwQTZzTfhSKAPU7g4XiMLXuUmgA7hvgn0LP05ClDvThfNzCS0DZUx2kc7hAy56bb7EP3DBr0kGLrbkVhX1j7xfLn1O0MChsriBhPeVuRNngQbOaU23lN6KiwrD9myX2S0dsxQ3Bb-S0T8w Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:03:40.628013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26f42f69c1b4f48b9a9746bfcc8fa5c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: 14824e303e544aa6b206e0692f703e5a Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.629528 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': 'c22bff83-6076-4522-87b8-762a5ee75a3f'} Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:03:40.633546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.634994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.636409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Returning 404 to user: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:03:40.636409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e451ea60-c3f3-495b-901b-e233761e00bf tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 404 len: 111 microversion: 2.1 time: 0.030813 Sep 08 20:03:40.636409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 469/906] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:03:40 2022] DELETE /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:03:40.638273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:03:40.638934 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] [instance: c22bff83-6076-4522-87b8-762a5ee75a3f] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:03:40.645832 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:40.646315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:40.646785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:40.647478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:03:40.647957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:03:40.648376 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:03:40.661866 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] HTTP exception thrown: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Request method failure captured: Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f HTTP/1.1 Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhYmnU6HFeiZH7jDYCvoI_qI66fSKJ4MFwQTZzTfhSKAPU7g4XiMLXuUmgA7hvgn0LP05ClDvThfNzCS0DZUx2kc7hAy56bb7EP3DBr0kGLrbkVhX1j7xfLn1O0MChsriBhPeVuRNngQbOaU23lN6KiwrD9myX2S0dsxQ3Bb-S0T8w Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:03:40.663428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f26f42f69c1b4f48b9a9746bfcc8fa5c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f26f42f69c1b4f48b9a9746bfcc8fa5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: f26f42f69c1b4f48b9a9746bfcc8fa5c Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1615683306 Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: 14824e303e544aa6b206e0692f703e5a Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeTestJSON-1615683306-project Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.665013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'c22bff83-6076-4522-87b8-762a5ee75a3f'} Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:03:40.669504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. Sep 08 20:03:40.671483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:03:40.672775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] Returning 404 to user: Instance c22bff83-6076-4522-87b8-762a5ee75a3f could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:03:40.672775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-70e1c188-9ca6-448b-aa75-227f9544a25e tempest-AttachVolumeTestJSON-1615683306 tempest-AttachVolumeTestJSON-1615683306-project] 10.222.0.44 "GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f" status: 404 len: 111 microversion: 2.1 time: 0.030493 Sep 08 20:03:40.672775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 438/907] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:03:40 2022] GET /compute/v2.1/servers/c22bff83-6076-4522-87b8-762a5ee75a3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:11.197649 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:11.198286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:11.201025 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:11.201681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:11.209424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:11.209852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:11.210285 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:11.210996 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:11.211640 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:11.212062 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:11.240964 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-39312b7e-9a06-4a89-8b6c-506027ca3c37 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/ips" status: 200 len: 150 microversion: 2.20 time: 0.047280 Sep 08 20:04:11.241547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 470/908] 10.222.0.44 () {60 vars in 1289 bytes} [Thu Sep 8 20:04:11 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:04:13.124950 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:13.125503 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:13.128883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:13.129589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:13.133676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:13.134158 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:13.134588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:13.135300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:13.136054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:13.136475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:13.161519 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lazy-loading 'flavor' on Instance uuid 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:04:13.352061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d2f806e1-b54c-46f3-b32e-b281279c6ec9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/action" status: 202 len: 0 microversion: 2.20 time: 0.230962 Sep 08 20:04:13.352704 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 439/909] 10.222.0.44 () {62 vars in 1319 bytes} [Thu Sep 8 20:04:13 2022] POST /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:04:13.361776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:13.362631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:13.370606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:13.371298 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:13.371838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:13.372780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:13.373245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:13.374308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:13.703802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:13.712352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:13.713793 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:13.714980 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-88b73a5a-6997-4a78-8279-042de3e926b1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.357785 Sep 08 20:04:13.715504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 471/910] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:13 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:14.741490 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:14.742161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:14.749165 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:14.749654 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:14.750088 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:14.750825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:14.751334 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:14.751779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:14.952109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:14.961095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:14.962529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:14.963733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-821aa3ca-860b-451c-a746-ffe8a7e422a6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.227379 Sep 08 20:04:14.970842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 440/911] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:14 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:15.990857 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:15.991507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:16.000283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:16.000902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:16.001450 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:16.002157 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:16.002610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:16.003068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:16.145653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:16.153975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:16.155426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:16.156592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e6270d95-3036-4bc1-a3d2-89c8b3f44a04 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.170636 Sep 08 20:04:16.157130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 472/912] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:15 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:16.324249 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:16.324745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:16.332882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:16.333628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:16.334257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:16.335007 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:16.335460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:16.335997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:16.376089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f7f5da4e-12b2-4b40-aab9-c44acb983a32 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/ips" status: 200 len: 149 microversion: 2.1 time: 0.055920 Sep 08 20:04:16.383618 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 441/913] 10.222.0.44 () {58 vars in 1248 bytes} [Thu Sep 8 20:04:16 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/ips => generated 149 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:04:17.185861 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:17.186829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:17.197151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:17.197960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:17.198742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:17.199860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:17.200624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:17.201330 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:17.349549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:17.362083 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:17.363737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:17.364919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-083b33a6-08c2-4905-bf94-dcb188ffa7f5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.185700 Sep 08 20:04:17.365471 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 473/914] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:17 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:17.715038 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa63029a-d3fd-439a-b54f-37fe7e9f0923"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:17.717566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:17.724379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:17.724863 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:17.725480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:17.726206 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:17.726702 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:17.727117 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:17.983514 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f70a3b93-6e0a-4072-85a0-b21e69f8a909 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "POST /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272362 Sep 08 20:04:17.989704 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 442/915] 10.222.0.44 () {60 vars in 1323 bytes} [Thu Sep 8 20:04:17 2022] POST /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:04:18.392259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:18.392870 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:18.399665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:18.400206 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:18.400703 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:18.401462 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:18.401940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:18.402412 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:18.533349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:18.541539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:18.543000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:18.544167 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2d501473-ecad-4c5e-887e-fcd4338b082e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.156267 Sep 08 20:04:18.544718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 474/916] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:18 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:19.570454 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:19.571251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:19.577727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:19.578212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:19.578652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:19.579358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:19.579805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:19.580223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:19.709983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:19.718252 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:19.719801 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:19.721076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fd6848cb-d60e-409a-a6bb-806f93850d5e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.155584 Sep 08 20:04:19.721695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 443/917] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:19 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:20.747066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:20.747736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:20.756080 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:20.756619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:20.757089 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:20.757854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:20.758359 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:20.758871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:20.893138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:20.901919 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:20.903403 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:20.904575 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-93bec15a-5232-4a87-bcf1-0401ba200b67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.162328 Sep 08 20:04:20.905141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 475/918] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:20 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:21.933595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:21.934602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:21.938957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:04:21.939237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 (ip 10.222.0.44) !!! Sep 08 20:04:21.949149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:21.949944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:21.950676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:21.951834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:21.952582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:21.953281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:22.100108 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:22.112012 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:22.114294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:22.116239 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6865d86d-44ad-461e-9ddb-f47639e0f245 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.189240 Sep 08 20:04:22.117428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 444/919] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:21 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:23.155655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:23.156630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:23.167143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:23.167860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:23.168507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:23.169559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:23.170243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:23.170905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:23.313922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:23.323620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:23.325333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:23.326995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-26541b1e-aa70-41f3-8907-a868116208de tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.178882 Sep 08 20:04:23.327630 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 476/920] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:23 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:24.357415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:24.358275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:24.368913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:24.369403 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:24.370212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:24.371224 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:24.371742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:24.372177 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:24.505279 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:24.514202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:24.515638 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:24.516805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-af195420-fee0-49ff-8853-f7fbf2f6bf4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.166152 Sep 08 20:04:24.517365 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 445/921] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:24 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:25.541753 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:25.542429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:25.549343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:25.549798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:25.550405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:25.551349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:25.551806 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:25.552252 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:25.656255 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:25.657325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:25.663908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:25.664484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:25.665030 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:25.665732 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:25.666180 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:25.666596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:25.684476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:25.692852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:25.694276 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:25.695506 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e9b6062f-6131-4586-97a4-ed4742198317 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.157920 Sep 08 20:04:25.696079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 477/922] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:25 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:25.753342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lazy-loading 'services' on Instance uuid f4988530-1ef8-47e1-b0f6-9feb057efa56 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:04:25.831195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4c82262b-80a1-4ea8-a573-a0f568cb27b3 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments/aa63029a-d3fd-439a-b54f-37fe7e9f0923" status: 202 len: 0 microversion: 2.1 time: 0.178565 Sep 08 20:04:25.832181 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 446/923] 10.222.0.44 () {58 vars in 1416 bytes} [Thu Sep 8 20:04:25 2022] DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments/aa63029a-d3fd-439a-b54f-37fe7e9f0923 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 20:04:25.842961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:25.845697 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:25.853935 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:25.854432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:25.854900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:25.855617 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:25.856107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:25.856566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:25.890792 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4e97bb8e-2411-44d4-9cb4-9f1033669883 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052674 Sep 08 20:04:25.891356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 478/924] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:04:25 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:04:26.723440 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:26.724243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:26.731353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:26.731837 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:26.732263 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:26.732945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:26.733398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:26.733814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:26.869558 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:26.878446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:26.879858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:26.881028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-95cc8e9a-6666-42dd-8004-32c527ecf021 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.163258 Sep 08 20:04:26.881561 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 447/925] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:26 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:26.903493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:26.905660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:26.912537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:26.913056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:26.913481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:26.914171 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:26.914659 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:26.915087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:26.946029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e563081d-79c9-4cfe-a952-9f008471e1cd tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046431 Sep 08 20:04:26.946564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 479/926] 10.222.0.44 () {58 vars in 1302 bytes} [Thu Sep 8 20:04:26 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 20:04:27.010525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:27.011054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:27.017578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:27.018060 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:27.018488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:27.019207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:27.019658 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:27.020079 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:27.046069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:04:27.129042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-47fd2053-2b2e-46d8-a117-c6b40a3c0fbf tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 204 len: 0 microversion: 2.1 time: 0.121957 Sep 08 20:04:27.129608 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 448/927] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:04:27 2022] DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:04:27.138328 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:27.138991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:27.144944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:27.145427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:27.145869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:27.146562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:27.147083 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:27.147491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:27.294056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:27.306179 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5860533a-6be8-4070-99f6-e8c32895bbde tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1680 microversion: 2.1 time: 0.171801 Sep 08 20:04:27.307040 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 480/928] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:27 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:04:27.911484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:27.912632 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:27.923422 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:27.924228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:27.924953 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:27.926221 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:27.926882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:27.927577 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:28.059886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:28.068646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:28.070059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:28.071258 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f2093ecc-fc6a-4a49-b3eb-66dd0da0bf18 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.167034 Sep 08 20:04:28.071816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 449/929] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:27 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:28.341912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:28.342836 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:28.353374 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:28.353858 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:28.354317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:28.355017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:28.355520 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:28.355947 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:28.483192 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:28.491152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-13c33887-4731-441a-8c80-44e4642da636 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1680 microversion: 2.1 time: 0.155896 Sep 08 20:04:28.491726 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 481/930] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:28 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:04:29.095881 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:29.096489 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:29.103278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:29.103774 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:29.104202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:29.104889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:29.105334 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:29.105746 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:29.109935 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:29.239767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:29.248539 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:29.249986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:29.251348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ac3c4a45-655a-41ff-a570-274395457bb4 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.159271 Sep 08 20:04:29.251716 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 450/931] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:29 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 20:04:29.521300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:29.521889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:29.528593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:29.529075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:29.529515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:29.530209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:29.530684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:29.531117 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:29.613313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e4a99cc6454715aa37ab5674d095d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32ecb482bb59452cae7dcaf0fa882a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:29.621758 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4be58d6d-da2d-4f18-a532-82185aecb575 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 200 len: 1612 microversion: 2.1 time: 0.104368 Sep 08 20:04:29.622310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 482/932] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:29 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 1612 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:04:29.682836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-095f2b92-d2a6-46f8-a1bb-8e743c948dc7 req-d7077804-c2c7-4951-b80f-5f4b97342ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4988530-1ef8-47e1-b0f6-9feb057efa56", "name": "network-vif-deleted", "tag": "f4f54f2b-3784-494a-bb0d-31bd0714b695"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:29.693313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-095f2b92-d2a6-46f8-a1bb-8e743c948dc7 req-d7077804-c2c7-4951-b80f-5f4b97342ffa service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:29.693815 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-095f2b92-d2a6-46f8-a1bb-8e743c948dc7 req-d7077804-c2c7-4951-b80f-5f4b97342ffa service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:29.694293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-095f2b92-d2a6-46f8-a1bb-8e743c948dc7 req-d7077804-c2c7-4951-b80f-5f4b97342ffa service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:29.710912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-095f2b92-d2a6-46f8-a1bb-8e743c948dc7 req-d7077804-c2c7-4951-b80f-5f4b97342ffa service nova] Creating event network-vif-deleted:f4f54f2b-3784-494a-bb0d-31bd0714b695 for instance f4988530-1ef8-47e1-b0f6-9feb057efa56 on hv-cinder-83124 Sep 08 20:04:29.716981 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-095f2b92-d2a6-46f8-a1bb-8e743c948dc7 req-d7077804-c2c7-4951-b80f-5f4b97342ffa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037761 Sep 08 20:04:29.717988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 451/933] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:04:30.276698 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:30.277228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:30.283476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:30.283970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:30.284405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:30.285080 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:30.285760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:30.286189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:30.425916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:30.435044 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:30.436634 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:30.437823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f0edc1bb-0424-4b3f-8e24-a99747dfba5a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1742 microversion: 2.20 time: 0.165396 Sep 08 20:04:30.438385 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 483/934] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:30 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:30.647058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:30.648012 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:30.654883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:30.655370 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:30.655772 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:30.656678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:30.657340 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:30.657767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:30.673724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 HTTP/1.1 Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:04:30.675450 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:30.676912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'f4988530-1ef8-47e1-b0f6-9feb057efa56'} Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:30.677750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:30.679089 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:30.680246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:30.680246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4d3337b5-59eb-4ae1-b202-76d01eae4ada tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 404 len: 111 microversion: 2.1 time: 0.035068 Sep 08 20:04:30.680246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 452/935] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:30 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:30.686264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d0bc6bc4-f2ef-4d2b-850e-3d4924a4e0ea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '.version_select at 0x7fef84bfd8b0>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:30.707395 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d0bc6bc4-f2ef-4d2b-850e-3d4924a4e0ea tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734651046" status: 202 len: 0 microversion: 2.1 time: 0.024861 Sep 08 20:04:30.708048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 484/936] 10.222.0.44 () {58 vars in 1218 bytes} [Thu Sep 8 20:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734651046 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 20:04:31.463742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:31.464336 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:31.472018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:31.472501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:31.472936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:31.473624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:31.474080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:31.474503 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:31.613047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:31.633365 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:31.636150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:31.637490 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-948873e5-aeea-4b21-bc59-bf03442ce8c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1742 microversion: 2.20 time: 0.177879 Sep 08 20:04:31.638688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 453/937] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:31 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:32.671820 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:32.672355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:32.679562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:32.680048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:32.680478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:32.681280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:32.681731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:32.682148 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:32.752841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:32.753420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:32.760273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:32.760764 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:32.761198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:32.761900 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:32.762356 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:32.762836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:32.778882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 HTTP/1.1 Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:04:32.780477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.782096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'f4988530-1ef8-47e1-b0f6-9feb057efa56'} Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:32.786005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.787511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.789067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:32.789067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a332c88d-3714-4042-9467-5084b695b1df tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 404 len: 111 microversion: 2.1 time: 0.032997 Sep 08 20:04:32.789067 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 454/938] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:04:32 2022] DELETE /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:32.791198 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:32.791802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: f4988530-1ef8-47e1-b0f6-9feb057efa56] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:32.797821 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:32.798330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:32.798791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:32.799532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:32.799997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:32.800418 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:32.813851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 HTTP/1.1 Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:04:32.815421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.817011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': 'f4988530-1ef8-47e1-b0f6-9feb057efa56'} Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:32.818223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. Sep 08 20:04:32.819715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:32.821082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance f4988530-1ef8-47e1-b0f6-9feb057efa56 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:32.821180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:32.821297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-186c97b8-ebf7-42c5-9558-e345ad588354 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56" status: 404 len: 111 microversion: 2.1 time: 0.029758 Sep 08 20:04:32.821297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 455/939] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:32 2022] GET /compute/v2.1/servers/f4988530-1ef8-47e1-b0f6-9feb057efa56 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 20:04:32.828432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:32.829931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:32.831214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b5de6e8f-0f89-478e-bf7e-7003ef354dc0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1742 microversion: 2.20 time: 0.164014 Sep 08 20:04:32.831846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 485/940] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:32 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:33.860357 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:33.861275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:33.871702 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:33.872187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:33.872619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:33.873315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:33.873767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:33.874189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:33.959816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:33.960364 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:33.967263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:33.967750 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:33.968194 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:33.968886 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:33.969334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:33.969759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:33.983756 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 HTTP/1.1 Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:04:33.985572 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:33.987124 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '36e3493f-fd10-45d6-bc85-4456db192b87'} Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:33.988057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:33.989494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:33.990972 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:33.991079 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-89575d69-7916-461d-b283-fa8002e36ea9 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 404 len: 111 microversion: 2.1 time: 0.035023 Sep 08 20:04:33.991675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 486/941] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:04:33 2022] DELETE /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:34.000349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:34.000985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 36e3493f-fd10-45d6-bc85-4456db192b87] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:34.007119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.007604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.008039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.008735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.009200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.009616 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.017194 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:34.023227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 HTTP/1.1 Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:04:34.024862 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:34.026672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '36e3493f-fd10-45d6-bc85-4456db192b87'} Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:34.027610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. Sep 08 20:04:34.029037 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.030216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:34.030311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 36e3493f-fd10-45d6-bc85-4456db192b87 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:34.030397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:34.030509 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6be366cb-5f35-4d47-8905-da81f2ea144f tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87" status: 404 len: 111 microversion: 2.1 time: 0.030903 Sep 08 20:04:34.030596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b16c3b0c-3402-425c-b1d2-5c00f679d28d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1742 microversion: 2.20 time: 0.174565 Sep 08 20:04:34.030715 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 487/943] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:33 2022] GET /compute/v2.1/servers/36e3493f-fd10-45d6-bc85-4456db192b87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 20:04:34.031730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 456/943] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:33 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1742 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:34.036758 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:34.037246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:34.043231 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.043704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.044118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.044795 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.045246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.045660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.058771 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe HTTP/1.1 Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:04:34.060263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.061864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '5070d059-02b2-46a5-84d5-020a048682fe'} Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:34.062748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.064287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.065745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:34.065745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-41dd5bd7-c2ca-4226-8a6b-5ecc7197ad69 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 404 len: 111 microversion: 2.1 time: 0.028453 Sep 08 20:04:34.065745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 488/944] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:04:34 2022] DELETE /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:34.069974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:34.070743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 5070d059-02b2-46a5-84d5-020a048682fe] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:34.076862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.077383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.077817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.078508 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.078988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.079413 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.092577 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe HTTP/1.1 Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:04:34.094086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.095795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '5070d059-02b2-46a5-84d5-020a048682fe'} Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:34.096763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. Sep 08 20:04:34.098232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:34.099593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 5070d059-02b2-46a5-84d5-020a048682fe could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:34.099593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-00d96e8d-cb38-4ab4-a78d-51736f53535c tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe" status: 404 len: 111 microversion: 2.1 time: 0.029392 Sep 08 20:04:34.099593 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 457/945] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:34 2022] GET /compute/v2.1/servers/5070d059-02b2-46a5-84d5-020a048682fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:34.434822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-d00039ed-d9fb-4050-9630-a43aebbf71a3 req-384b37a4-2294-4d88-af95-84c2dab2f525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "name": "network-vif-plugged", "status": "completed", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:34.445290 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d00039ed-d9fb-4050-9630-a43aebbf71a3 req-384b37a4-2294-4d88-af95-84c2dab2f525 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:34.445766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d00039ed-d9fb-4050-9630-a43aebbf71a3 req-384b37a4-2294-4d88-af95-84c2dab2f525 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:34.446229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-d00039ed-d9fb-4050-9630-a43aebbf71a3 req-384b37a4-2294-4d88-af95-84c2dab2f525 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:34.461127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-d00039ed-d9fb-4050-9630-a43aebbf71a3 req-384b37a4-2294-4d88-af95-84c2dab2f525 service nova] Creating event network-vif-plugged:0f999fed-be11-407f-ae8e-d916dbc59b56 for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 on hv-cinder-83124 Sep 08 20:04:34.467299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-d00039ed-d9fb-4050-9630-a43aebbf71a3 req-384b37a4-2294-4d88-af95-84c2dab2f525 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036683 Sep 08 20:04:34.467915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 489/946] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:04:35.053889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:35.054566 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:35.062574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:35.063095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:35.063531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:35.064240 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:35.064696 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:35.065120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:35.193477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:35.202628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:35.204427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:35.205645 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-836f97cc-94c7-408e-9618-1ce129533277 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.156377 Sep 08 20:04:35.206414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 458/947] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:35 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:35.239681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:35.240267 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:35.248107 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:35.248684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:35.249283 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:35.250061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:35.250593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:35.251106 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:35.266090 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e HTTP/1.1 Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:04:35.267951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.269487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '6f740383-c694-46e4-adea-1b308e00014e'} Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:35.270345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.271833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.273299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:35.273299 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2f710c0f-2b7e-4c4c-9f5e-4244dfaa3de4 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 404 len: 111 microversion: 2.1 time: 0.037665 Sep 08 20:04:35.275304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 490/948] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:04:35 2022] DELETE /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:35.288038 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:35.288657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] [instance: 6f740383-c694-46e4-adea-1b308e00014e] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:35.295271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:35.295753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:35.296181 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:35.296872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:35.297317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:35.297738 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:35.312437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] HTTP exception thrown: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Request method failure captured: Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e HTTP/1.1 Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkhWsXXlG49zhhNbwRyLrX4CWwSyHy2ZEHKPSGqytnesN4OnfBMBb4clTEaez2HXRNeXrEBNVnvIC2hh7MG-SixqjO1AlwJMt9gcEO6EuPOKU2X_lM7PAdUZk_sqIT6nTPrpaUk5hzVQ9-gLD7znE4DPHpvRbZFudZsOU4Iy4qYif_I Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:04:35.313980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_32ecb482bb59452cae7dcaf0fa882a7a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/32ecb482bb59452cae7dcaf0fa882a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 32ecb482bb59452cae7dcaf0fa882a7a Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1333329901 Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: b7e4a99cc6454715aa37ab5674d095d6 Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeNegativeTest-1333329901-project Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.315614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '6f740383-c694-46e4-adea-1b308e00014e'} Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:04:35.320251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. Sep 08 20:04:35.322205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:04:35.323600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] Returning 404 to user: Instance 6f740383-c694-46e4-adea-1b308e00014e could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:04:35.323600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-47242c3e-9452-4912-bfd3-eb529c507938 tempest-AttachVolumeNegativeTest-1333329901 tempest-AttachVolumeNegativeTest-1333329901-project] 10.222.0.44 "GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e" status: 404 len: 111 microversion: 2.1 time: 0.035949 Sep 08 20:04:35.323600 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 459/949] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:04:35 2022] GET /compute/v2.1/servers/6f740383-c694-46e4-adea-1b308e00014e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:04:36.237583 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:36.238383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:36.251592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:36.252260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:36.252722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:36.253714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:36.254388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:36.255239 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:36.276799 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=100 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:36.520741 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:36.533286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:36.535019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:36.538850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6a8d1e74-9810-4b76-8ff9-98e9d2409279 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.305304 Sep 08 20:04:36.539414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 491/950] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:36 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 20:04:37.568614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:37.569862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:37.586752 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:37.589128 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:37.589844 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:37.590606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:37.591099 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:37.591693 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:37.836035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:37.851771 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:37.857238 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:37.861421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-50936763-87e3-4883-aa49-279bfa9fef86 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.297926 Sep 08 20:04:37.862031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 460/951] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:37 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:38.887728 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:38.890257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:38.903663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:38.908477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:38.909450 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:38.910418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:38.911113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:38.912588 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:39.257884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:39.266794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:39.272418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:39.275639 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c81eea50-d364-49a6-844a-97a6dc9ca2fc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.392023 Sep 08 20:04:39.278078 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 492/952] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:38 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:40.302564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:40.304005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:40.312005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:40.313094 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:40.313867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:40.314935 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:40.315596 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:40.316216 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:40.490556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:40.501510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:40.503362 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:40.504801 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0f4eab46-2bb0-4e12-a5b9-78fff62fa098 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.207081 Sep 08 20:04:40.505776 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 461/953] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:40 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:41.529409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:41.529999 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:41.535914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:41.537624 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:41.538433 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:41.538985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:41.540015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:41.540657 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:41.541350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:41.702238 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:41.713170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:41.715030 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:41.716653 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-29fdc6bc-7915-4676-8a27-0286e984f77e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.191243 Sep 08 20:04:41.717683 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 493/954] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:41 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:42.746438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:42.747483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:42.754204 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:42.754725 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:42.755164 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:42.755870 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:42.756327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:42.756751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:42.907937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:42.916717 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:42.918242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:42.919486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-98581e52-18e1-4e58-9eb3-3a0d0cd7a7cc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.177804 Sep 08 20:04:42.920243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 462/955] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:42 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:43.950933 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:43.951675 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:43.959289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:43.959792 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:43.960225 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:43.960952 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:43.961401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:43.961832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:44.130277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:44.139622 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:44.141123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:44.142361 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2cec8216-209a-48cb-947c-de134d04ced6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.197177 Sep 08 20:04:44.143341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 494/956] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:43 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:45.171958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:45.172802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:45.176928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:45.185096 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:45.185583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:45.186045 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:45.186760 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:45.187217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:45.187635 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:45.322530 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:45.334739 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:45.336579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:45.338398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d3058835-c043-4f19-a43f-c49e3e4aaa58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1737 microversion: 2.20 time: 0.172905 Sep 08 20:04:45.339113 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 463/957] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:45 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:46.364242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:46.364856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:46.373832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:46.374614 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:46.375342 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:46.376475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:46.377229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:46.377968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:46.524605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:46.533597 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:46.535092 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:46.536243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ffb5d106-dcc0-46c1-a05a-46b3c8d27642 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1719 microversion: 2.20 time: 0.176292 Sep 08 20:04:46.536803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 495/958] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:46 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:47.561688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:47.562233 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:47.569288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:47.569778 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:47.570223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:47.570952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:47.571375 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:47.571832 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:47.718288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:47.726912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:47.728346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:47.729514 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-67802e22-8a6d-4bed-b7e5-77a98c8bcb01 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1719 microversion: 2.20 time: 0.171946 Sep 08 20:04:47.730802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 464/959] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:47 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:48.756119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:48.756764 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:48.763722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:48.764219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:48.764656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:48.765356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:48.766264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:48.766739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:48.904983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:48.916221 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:48.917823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:48.919290 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-eee4d617-47b3-43ea-9776-d1d9ef637e7a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1662 microversion: 2.20 time: 0.167324 Sep 08 20:04:48.919830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 496/960] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:48 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1662 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:48.943556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b32ee4-cabf-4c4c-b046-cd5034010b3b"}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:48.945934 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:48.952329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:48.952802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:48.953309 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:48.953992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:48.954429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:48.954918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:49.253327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fccc81ba-a6aa-47a9-82cc-eb392838c5dd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.313518 Sep 08 20:04:49.253946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 465/961] 10.222.0.44 () {62 vars in 1364 bytes} [Thu Sep 8 20:04:48 2022] POST /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments => generated 188 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:04:49.387895 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:49.388479 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:49.395135 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:49.395759 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:49.396241 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:49.397068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:49.397642 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:49.398111 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:49.536141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120484) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 20:04:49.609073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-37fa8b33-7c76-47d1-9158-5a2b03d35b5c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/action" status: 202 len: 0 microversion: 2.20 time: 0.225202 Sep 08 20:04:49.609706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 497/962] 10.222.0.44 () {62 vars in 1319 bytes} [Thu Sep 8 20:04:49 2022] POST /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:04:49.617958 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:49.618570 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:49.625826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:49.626317 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:49.626782 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:49.627509 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:49.627963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:49.628372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:49.767672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:49.777022 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:49.778556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:49.779755 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7d41e417-8c46-44c3-9103-cb2dfbc3c04c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1748 microversion: 2.20 time: 0.165770 Sep 08 20:04:49.780504 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 466/963] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:49 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:50.471682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-6f844d31-da0d-405d-8cb1-ae2929cfc6ad req-8a6d0ada-953c-4d36-8edf-cd056517c266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "name": "network-vif-unplugged", "status": "completed", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:04:50.482477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6f844d31-da0d-405d-8cb1-ae2929cfc6ad req-8a6d0ada-953c-4d36-8edf-cd056517c266 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:50.483378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6f844d31-da0d-405d-8cb1-ae2929cfc6ad req-8a6d0ada-953c-4d36-8edf-cd056517c266 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:50.484688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6f844d31-da0d-405d-8cb1-ae2929cfc6ad req-8a6d0ada-953c-4d36-8edf-cd056517c266 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:50.497425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.compute.server_external_events [req-6f844d31-da0d-405d-8cb1-ae2929cfc6ad req-8a6d0ada-953c-4d36-8edf-cd056517c266 service nova] Unable to find a host for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48. Dropping event network-vif-unplugged {{(pid=120484) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 20:04:50.498593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-6f844d31-da0d-405d-8cb1-ae2929cfc6ad req-8a6d0ada-953c-4d36-8edf-cd056517c266 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031337 Sep 08 20:04:50.499370 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 498/964] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 20:04:50.807998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:50.809173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:50.818568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:50.819316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:50.819939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:50.820935 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:50.821586 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:50.822185 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:50.955276 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:50.963988 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:50.965472 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:50.966715 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f95feaf7-d37f-45d9-95a9-1c2394b36eaf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1750 microversion: 2.20 time: 0.164787 Sep 08 20:04:50.967266 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 467/965] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:50 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:51.991798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:51.992361 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:51.999872 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:52.000332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:52.000791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:52.001489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:52.001938 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:52.002357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:52.458666 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:52.469105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:52.470534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:52.471748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-1692e5a8-a933-4332-9f97-cf235369d030 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.483950 Sep 08 20:04:52.472317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 499/966] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:51 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:53.499100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:53.501127 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:53.508351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:53.508931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:53.509438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:53.510154 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:53.510825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:53.511251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:53.515576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:04:53.655148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:53.664391 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:53.665893 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:53.667203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9cc65c1a-1dcf-4748-b3d0-1a14cc279bd6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.173755 Sep 08 20:04:53.667842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 468/967] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:53 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:54.693556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:54.694211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:54.702014 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:54.702546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:54.703017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:54.703733 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:54.704193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:54.704621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:54.854055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:54.863540 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:54.864982 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:54.866166 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-fba91900-d4ac-486c-b4ab-ea092703cb53 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.176641 Sep 08 20:04:54.866761 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 500/968] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:54 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:55.895083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:55.896775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:55.906944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:55.907819 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:55.908251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:55.909105 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:55.909760 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:55.910161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:56.049131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:56.063184 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:56.065058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:56.066704 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9d4298b6-87ae-4ba4-910a-557ca9bebc52 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.177135 Sep 08 20:04:56.067935 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 469/969] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:55 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:57.093627 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:57.095794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:57.103504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:57.104003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:57.104498 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:57.105425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:57.105880 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:57.106314 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:57.272684 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:57.283744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:57.285198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:57.286714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-37c4e2e8-d74a-4241-ba32-467d4d9445a2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.197599 Sep 08 20:04:57.287912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 501/970] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:57 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:58.315905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:58.316701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:58.323372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:58.323895 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:58.324331 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:58.325098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:58.325731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:58.326159 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:58.514592 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:58.523475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:58.524948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:58.526111 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b52e0cd5-5637-4606-bd3e-254cc4e7f9db tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.214515 Sep 08 20:04:58.526681 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 470/971] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:58 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:04:59.551646 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:04:59.552300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:04:59.562297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:59.562830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:59.563367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:59.564132 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:04:59.564816 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:04:59.565245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:04:59.735198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:59.745026 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:59.747645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:04:59.748823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6f6611ee-abf9-4d6f-a177-32ae8456dbe3 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.201242 Sep 08 20:04:59.749690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 502/972] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:04:59 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:00.773601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:00.774208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:00.781070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:00.781552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:00.781987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:00.782700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:00.783161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:00.783583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:00.925301 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:00.935234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:00.936736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:00.937920 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fc185475-ef42-42ee-b8a9-6cd63aadfe80 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.168405 Sep 08 20:05:00.938839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 471/973] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:00 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:01.967866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:01.968804 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:01.979918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:01.980739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:01.981466 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:01.982730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:01.983192 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:01.983621 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:02.112219 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:02.121287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:02.122744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:02.123897 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9187693e-b238-4749-a27a-2767729bbbce tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.162741 Sep 08 20:05:02.124470 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 503/974] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:01 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:03.148537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:03.149209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:03.156522 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:03.157080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:03.157601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:03.158293 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:03.158783 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:03.159203 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:03.291189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:03.299997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:03.301415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:03.302573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-795aaf00-9153-46d1-9e43-84f513f80150 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.158112 Sep 08 20:05:03.303155 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 472/975] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:03 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:04.332800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:04.333757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:04.344714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:04.345579 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:04.346343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:04.347544 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:04.348311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:04.349017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:04.491405 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:04.500656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:04.502141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:04.503310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-83f9ae21-6e52-4809-a43f-38bee231ce0e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.177153 Sep 08 20:05:04.503924 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 504/976] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:04 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:05.531010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:05.532273 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:05.541809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:05.542469 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:05.543091 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:05.544025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:05.544637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:05.545202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:05.679155 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:05.687995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:05.689512 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:05.690724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-32df95f0-4446-4577-ae65-639a596913e7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.165561 Sep 08 20:05:05.691281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 473/977] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:05 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:06.716027 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:06.717307 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:06.724199 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:06.724719 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:06.725149 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:06.725844 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:06.726631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:06.727188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:06.729960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:05:06.868594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:06.878570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:06.880022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:06.881178 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4e817891-af03-45c7-b5d5-fac38bb25aa9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.168999 Sep 08 20:05:06.881738 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 505/978] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:06 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:07.910119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:07.911148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:07.922131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:07.922590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:07.923080 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:07.923869 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:07.924333 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:07.924753 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:08.066171 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:08.075513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:08.076933 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:08.078169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-dcb3e94d-780b-45a4-a20c-35e616ecdf90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.174627 Sep 08 20:05:08.078767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 474/979] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:07 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:09.109383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:09.109991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:09.116748 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:09.117229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:09.117655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:09.118338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:09.119180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:09.119626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:09.255000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:09.264027 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:09.265518 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:09.266715 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-82523eac-6d90-4871-831c-e7da9c2a9b41 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.161204 Sep 08 20:05:09.267268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 506/980] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:09 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:10.291952 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:10.292679 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:10.299823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:10.300306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:10.300737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:10.301429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:10.301882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:10.302300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:10.434829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:10.444411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:10.445830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:10.447033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1cbc6dcd-d454-4673-91e9-da278751787f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.159952 Sep 08 20:05:10.447590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 475/981] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:10 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:11.473013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:11.473724 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:11.481727 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:11.482293 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:11.482838 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:11.483654 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:11.484188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:11.484655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:11.613130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:11.622663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:11.624093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:11.627071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-765bd56c-0134-4fd5-89f0-77cb98d765dc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.156955 Sep 08 20:05:11.627718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 507/982] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:11 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:12.654021 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:12.654789 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:12.661431 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:12.661918 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:12.662809 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:12.663515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:12.664163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:12.664614 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:12.805299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:12.814037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:12.815605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:12.816766 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-80282a9d-14d9-41d6-b90a-7bbe93539f67 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.166838 Sep 08 20:05:12.817307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 476/983] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:12 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:13.841971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:13.842587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:13.845050 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:05:13.851984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:13.852481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:13.852907 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:13.853631 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:13.854568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:13.854568 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:13.988392 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:13.997920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:13.999389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:14.000556 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-44e7a225-ad40-4b5f-a7aa-3fda9e7b40e5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.162608 Sep 08 20:05:14.001113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 508/984] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:13 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:15.025855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:15.026494 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:15.033391 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:15.034079 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:15.035085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:15.036029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:15.036588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:15.036908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:15.170211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:15.180256 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:15.182048 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:15.183373 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ab66e0e6-212f-42d5-ab46-171d057b41f8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.161921 Sep 08 20:05:15.184017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 477/985] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:15 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:16.208485 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:16.209521 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:16.218492 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:16.219003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:16.219436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:16.220224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:16.220676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:16.221077 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:16.359633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:16.368637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:16.370772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:16.371982 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-31c004d9-2192-44da-b55b-a238b1d07b42 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.168089 Sep 08 20:05:16.372510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 509/986] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:16 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:17.397333 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:17.398064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:17.400603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=30 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:05:17.406316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:17.406830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:17.407260 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:17.408791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:17.409285 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:17.409734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:17.540985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:17.550807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:17.552449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:17.553604 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9ce73c67-bee1-48ee-8f9c-6e8286ae7792 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.160490 Sep 08 20:05:17.554162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 478/987] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:17 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:18.578842 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:18.579979 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:18.586224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:18.586711 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:18.587172 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:18.587866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:18.588320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:18.588740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:18.736786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:18.752338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:18.754045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:18.755436 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8a481ea0-6f7a-4437-be16-1f76ec0e2b58 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.180576 Sep 08 20:05:18.756563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 510/988] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:18 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:18.902232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-ac006411-d94f-4f78-bc4a-d715f7089431 req-232da102-e379-401b-80a4-b4d0f2d1d86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "name": "network-vif-plugged", "status": "completed", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:05:18.913946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-ac006411-d94f-4f78-bc4a-d715f7089431 req-232da102-e379-401b-80a4-b4d0f2d1d86b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:18.914445 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-ac006411-d94f-4f78-bc4a-d715f7089431 req-232da102-e379-401b-80a4-b4d0f2d1d86b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:18.914949 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-ac006411-d94f-4f78-bc4a-d715f7089431 req-232da102-e379-401b-80a4-b4d0f2d1d86b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:18.931709 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-ac006411-d94f-4f78-bc4a-d715f7089431 req-232da102-e379-401b-80a4-b4d0f2d1d86b service nova] Creating event network-vif-plugged:0f999fed-be11-407f-ae8e-d916dbc59b56 for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 on hv-cinder-83124 Sep 08 20:05:18.938496 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-ac006411-d94f-4f78-bc4a-d715f7089431 req-232da102-e379-401b-80a4-b4d0f2d1d86b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039996 Sep 08 20:05:18.939474 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 479/989] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:05:19.781161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:19.781765 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:19.788145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:19.788628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:19.789063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:19.789753 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:19.790213 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:19.790668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:19.921856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:19.930963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:19.932371 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:19.933530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-731280d9-0a88-4cc8-948f-b3b452975edb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.156306 Sep 08 20:05:19.945145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 511/990] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:19 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:20.959035 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:20.960603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:20.967609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:20.968102 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:20.968549 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:20.969249 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:20.969713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:20.970169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:21.108741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:21.118004 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:21.119885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:21.121071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-29e5ea19-a936-4b44-bbff-30d93b45885c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1806 microversion: 2.20 time: 0.166378 Sep 08 20:05:21.121693 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 480/991] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:20 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:05:22.145487 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:05:22.146069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:05:22.152798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:22.153286 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:22.153723 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:22.154424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:05:22.154905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:05:22.155310 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:05:22.290546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:22.300931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:22.302357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:05:22.303577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c78e0b1f-8c6e-4d4b-9b15-a6d40ae42975 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1793 microversion: 2.20 time: 0.162027 Sep 08 20:05:22.304128 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 512/992] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:05:22 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1793 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:03.762937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=5 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:03.764133 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=72 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:03.765016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:06:03.765334 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:06:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.44) !!! Sep 08 20:06:03.975396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ccfbed92-69dc-468e-a936-f4c0c2862eda tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Action: 'create', calling method: .version_select at 0x7fef84dcd550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-202422694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ4c635QoUP9nJVo4rLooU/jatAVzhEtBAWwk6qUTZ06EsxtMe7Ue/7d0hyfq9g1P5fxBPNBcB9N09mGIHJbpu/NsYVDF6oAYbZfva9/W8lMwcMhUzVYWIeBEvCkGr7aQ=="}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:03.991179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-ccfbed92-69dc-468e-a936-f4c0c2862eda tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for project 3020f7128e9e434d82b72b9760db31ba. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:06:03.995430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-ccfbed92-69dc-468e-a936-f4c0c2862eda tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for user cb5ed38c1e2640919b16746d42494d65 and project 3020f7128e9e434d82b72b9760db31ba. Resources: {'key_pairs'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:06:04.030991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ccfbed92-69dc-468e-a936-f4c0c2862eda tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.276777 Sep 08 20:06:04.031598 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 481/993] 10.222.0.44 () {60 vars in 1159 bytes} [Thu Sep 8 20:06:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:21.035278 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:21.036137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:21.039551 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=9 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:21.040636 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=47 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:21.048491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:21.048968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:21.049404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:21.050087 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:21.050529 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:21.050980 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:21.080499 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-de9962de-bdc3-42c5-a9e7-22be913d5af8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments/57b32ee4-cabf-4c4c-b046-cd5034010b3b" status: 200 len: 194 microversion: 2.20 time: 0.052191 Sep 08 20:06:21.081063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 513/994] 10.222.0.44 () {60 vars in 1454 bytes} [Thu Sep 8 20:06:21 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments/57b32ee4-cabf-4c4c-b046-cd5034010b3b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:06:21.149017 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:21.149744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:21.155447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:21.156163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:21.167329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:21.168100 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:21.168547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:21.169249 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:21.169700 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:21.170128 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:21.254672 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lazy-loading 'services' on Instance uuid 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:06:21.343256 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1e0075ac-6282-4dc3-b4cf-da7773f6d66d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments/57b32ee4-cabf-4c4c-b046-cd5034010b3b" status: 202 len: 0 microversion: 2.20 time: 0.196707 Sep 08 20:06:21.343879 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 482/995] 10.222.0.44 () {60 vars in 1457 bytes} [Thu Sep 8 20:06:21 2022] DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments/57b32ee4-cabf-4c4c-b046-cd5034010b3b => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:06:21.352508 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:21.355130 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:21.361692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:21.362184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:21.362617 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:21.363331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:21.363867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:21.364241 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:21.395256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b4f6825b-464c-4fa3-bb91-752e528e6f85 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046653 Sep 08 20:06:21.395798 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 514/996] 10.222.0.44 () {60 vars in 1343 bytes} [Thu Sep 8 20:06:21 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:06:22.414271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:22.418005 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:22.428486 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:22.429279 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:22.429980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:22.431139 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:22.431886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:22.432585 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:22.463302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0a688e2e-51ff-470c-969e-04b2dc6af146 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057308 Sep 08 20:06:22.463785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 483/997] 10.222.0.44 () {60 vars in 1343 bytes} [Thu Sep 8 20:06:22 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:22.539679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:22.540210 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:22.548330 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:22.548975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:22.549610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:22.550608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:22.551302 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:22.551799 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:22.586707 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Going to try to terminate instance {{(pid=120484) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:06:22.666679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d1989612-3190-451c-b157-6dd66aedf7c6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 204 len: 0 microversion: 2.20 time: 0.130553 Sep 08 20:06:22.667270 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 515/998] 10.222.0.44 () {60 vars in 1280 bytes} [Thu Sep 8 20:06:22 2022] DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 20:06:22.677353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:22.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:22.685381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:22.685874 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:22.686308 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:22.687049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:22.687506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:22.687930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:22.823380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:22.831920 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:22.833366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:22.834538 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a4f9cd7f-cc0c-4739-841d-ba3572868ec5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.162253 Sep 08 20:06:22.838281 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 484/999] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:22 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:23.860888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:23.861582 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:23.868735 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:23.869202 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:23.869633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:23.870317 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:23.870810 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:23.871277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:24.015967 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:24.028383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:24.030378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:24.032118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-95db6572-43db-4a15-bba3-20ea57d52252 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.175414 Sep 08 20:06:24.032912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 516/1000] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:23 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:25.062077 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:25.062679 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:25.069885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:25.070387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:25.070860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:25.071588 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:25.072046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:25.072472 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:25.213791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:25.222969 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:25.224415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:25.225642 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ffc40489-d91b-4c00-81b5-23a89e2e7b83 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1721 microversion: 2.20 time: 0.167794 Sep 08 20:06:25.226221 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 485/1001] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:25 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:25.963603 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-91242dde-5c96-4b59-9db0-89128c4748e1 req-375a2ba7-5fcb-4042-828f-7fa903c99cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16fc41bf-38bc-4704-bebf-b52e1b4f1f48", "name": "network-vif-deleted", "tag": "0f999fed-be11-407f-ae8e-d916dbc59b56"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:25.975746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-91242dde-5c96-4b59-9db0-89128c4748e1 req-375a2ba7-5fcb-4042-828f-7fa903c99cf3 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:25.976298 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-91242dde-5c96-4b59-9db0-89128c4748e1 req-375a2ba7-5fcb-4042-828f-7fa903c99cf3 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:25.977073 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-91242dde-5c96-4b59-9db0-89128c4748e1 req-375a2ba7-5fcb-4042-828f-7fa903c99cf3 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:25.992943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-91242dde-5c96-4b59-9db0-89128c4748e1 req-375a2ba7-5fcb-4042-828f-7fa903c99cf3 service nova] Creating event network-vif-deleted:0f999fed-be11-407f-ae8e-d916dbc59b56 for instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 on hv-cinder-83124 Sep 08 20:06:25.999694 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-91242dde-5c96-4b59-9db0-89128c4748e1 req-375a2ba7-5fcb-4042-828f-7fa903c99cf3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115405 Sep 08 20:06:26.001038 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 517/1002] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:26.252735 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:26.253278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:26.260213 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:26.260692 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:26.261124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:26.261813 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:26.262362 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:26.262896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:26.294193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:26.294671 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:26.295119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:26.295555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lazy-loading 'fault' on Instance uuid 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:06:26.336630 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:26.345286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:26.346727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:26.347892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c6ae31ae-31bd-4fc8-beef-364c6e38ce1e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 200 len: 1370 microversion: 2.20 time: 0.099312 Sep 08 20:06:26.348460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 486/1003] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:26 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:27.021679 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-632618263", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-202422694", "security_groups": [{"name": "tempest-secgroup-smoke-1476250419"}], "block_device_mapping_v2": [{"uuid": "bd536582-9bd6-4c4c-b3a8-1f9ebe21e705", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da0828a8-6f51-4654-9c86-6904ed730ff8"}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:27.163452 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] validate_networks() for [('da0828a8-6f51-4654-9c86-6904ed730ff8', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:06:27.374114 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:27.374839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:27.382367 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:27.382964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:27.383484 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:27.384298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:27.384823 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:27.385520 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:27.401246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] HTTP exception thrown: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Request method failure captured: Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 HTTP/1.1 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkpgd3ji_C4wwYiCGZOIQ2tX6IAml7PbkRO5VOKszafvfpB1UnYxUg95hV-Lv8T56C47aK0t6j65c-5eaQbgoUZV3_DWufbN0fOaA8_yPW7BpmkWJLhzEZ79lq657K1StDU81B4TmR-MWYclKB_3OKKMKnurKMnm9fypQgP2Lj5tiSI Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:06:27.403054 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5600d866afb84f53882c2a5fb07298b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: e582f450b96c4e37ad88501bfa02441e Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:06:27.404916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '16fc41bf-38bc-4704-bebf-b52e1b4f1f48'} Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:06:27.406346 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:06:27.408492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:06:27.410253 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Returning 404 to user: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:06:27.410253 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d51218ce-779b-40c3-8123-70f1af4b3073 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 404 len: 111 microversion: 2.20 time: 0.035463 Sep 08 20:06:27.410253 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 487/1004] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:27 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:06:27.415658 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-de10e733-6b6c-411e-a869-682843694fca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '.version_select at 0x7fef85066700>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:27.440144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-de10e733-6b6c-411e-a869-682843694fca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268392082" status: 204 len: 0 microversion: 2.20 time: 0.024510 Sep 08 20:06:27.440144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 488/1005] 10.222.0.44 () {60 vars in 1259 bytes} [Thu Sep 8 20:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268392082 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 20:06:27.578430 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:06:27.578890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:06:27.579365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:06:27.579776 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:06:27.580189 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:06:27.589721 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:27.590224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:27.590780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:27.591641 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:27.592000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:27.592397 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:27.610846 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for project 3020f7128e9e434d82b72b9760db31ba. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:06:27.615011 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for user cb5ed38c1e2640919b16746d42494d65 and project 3020f7128e9e434d82b72b9760db31ba. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:06:27.677257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:06:27.679696 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd536582-9bd6-4c4c-b3a8-1f9ebe21e705',volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:06:27.847258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-10d3c4e7-af1b-4cf6-9de4-03da36e5e058 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829482 Sep 08 20:06:27.848292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 518/1006] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 20:06:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 20:06:27.860011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7caa9310-e16d-4444-b2a8-1029e2505c5a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:27.860736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7caa9310-e16d-4444-b2a8-1029e2505c5a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:27.952605 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7caa9310-e16d-4444-b2a8-1029e2505c5a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:27.961147 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7caa9310-e16d-4444-b2a8-1029e2505c5a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1093 microversion: 2.1 time: 0.105499 Sep 08 20:06:27.961690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 489/1007] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:27 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1093 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:28.383494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7a076e98-c72d-46da-b90c-85fa51e22306 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'create', calling method: .version_select at 0x7fef84baf820>, body: {"keypair": {"name": "tempest-keypair-2101423698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqkEulUVn4olHBO9CC/3AiVtVbtD2ZQ185teNgU+LDSIZOXbhp09BfNyKvui/Mr6bKeXVCsvFfSsxnKcdRxiUwwv0KgGGxChGyPt0DYsTVPvFarAkiqEyoxT5cT5N4U3g=="}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:28.399873 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7a076e98-c72d-46da-b90c-85fa51e22306 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for project 5600d866afb84f53882c2a5fb07298b4. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:06:28.403871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7a076e98-c72d-46da-b90c-85fa51e22306 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for user e582f450b96c4e37ad88501bfa02441e and project 5600d866afb84f53882c2a5fb07298b4. Resources: {'key_pairs'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:06:28.428526 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7a076e98-c72d-46da-b90c-85fa51e22306 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048855 Sep 08 20:06:28.429214 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 519/1008] 10.222.0.44 () {62 vars in 1200 bytes} [Thu Sep 8 20:06:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 20:06:28.984326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:28.985056 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:28.991931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:28.992740 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:28.993174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:28.993911 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:28.994389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:28.995090 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:29.061992 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:29.071880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5ec2bfda-923f-43ec-9bfb-e14116f96bfb tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1209 microversion: 2.1 time: 0.091330 Sep 08 20:06:29.072468 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 490/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:28 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:30.096289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:30.097017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:30.104663 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:30.105313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:30.105879 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:30.106906 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:30.107448 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:30.108126 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:30.392803 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:30.400835 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e6e5f0f3-2dd5-4082-8afc-e975939ffa34 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.309520 Sep 08 20:06:30.401665 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 520/1010] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:30 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:30.479401 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-361095071", "imageRef": "bdb95d1b-51c5-4e8c-a511-194669386987", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "90750b96-72bd-43c4-9fad-72ba52340af3"}], "security_groups": [{"name": "tempest-securitygroup--1357702439"}], "key_name": "tempest-keypair-2101423698", "user_data": "}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:30.587438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.network.neutron [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] validate_networks() for [('90750b96-72bd-43c4-9fad-72ba52340af3', None, None, None, None, None)] {{(pid=120485) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:06:30.937801 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-29922177-fdfa-44ab-85c5-11b2bf24aeb4 req-c5fbcb18-8a3e-4d1f-9269-44b7929ba9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5c169e-c871-4979-9342-b3a5c96770a4", "tag": "152189bb-1eba-44b5-a0eb-5d9fbbb86b5d"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:30.953557 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-29922177-fdfa-44ab-85c5-11b2bf24aeb4 req-c5fbcb18-8a3e-4d1f-9269-44b7929ba9eb service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:30.954133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-29922177-fdfa-44ab-85c5-11b2bf24aeb4 req-c5fbcb18-8a3e-4d1f-9269-44b7929ba9eb service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:30.954608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-29922177-fdfa-44ab-85c5-11b2bf24aeb4 req-c5fbcb18-8a3e-4d1f-9269-44b7929ba9eb service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:30.966876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-29922177-fdfa-44ab-85c5-11b2bf24aeb4 req-c5fbcb18-8a3e-4d1f-9269-44b7929ba9eb service nova] Creating event network-changed:152189bb-1eba-44b5-a0eb-5d9fbbb86b5d for instance 7a5c169e-c871-4979-9342-b3a5c96770a4 on hv-cinder-83124 Sep 08 20:06:30.972516 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-29922177-fdfa-44ab-85c5-11b2bf24aeb4 req-c5fbcb18-8a3e-4d1f-9269-44b7929ba9eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042650 Sep 08 20:06:30.974230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 521/1011] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:31.083124 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Flavor limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:06:31.083544 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Image limits 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:06:31.084013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Flavor pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:06:31.084412 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Image pref 0:0:0 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:06:31.084814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.virt.hardware [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120485) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:06:31.094429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:31.094894 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:31.095319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:31.096051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:31.096511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:31.096928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:31.114242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for project 5600d866afb84f53882c2a5fb07298b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:06:31.118771 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.quota [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Getting quotas for user e582f450b96c4e37ad88501bfa02441e and project 5600d866afb84f53882c2a5fb07298b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120485) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:06:31.130284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Going to run 1 instances... {{(pid=120485) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:06:31.132652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bdb95d1b-51c5-4e8c-a511-194669386987',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120485) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:06:31.182649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-97642824-0431-4bde-97fd-4f64e1c99c22 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.707724 Sep 08 20:06:31.183327 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 491/1012] 10.222.0.44 () {62 vars in 1188 bytes} [Thu Sep 8 20:06:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 20:06:31.195705 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-43434c33-6c95-4da6-a5db-0ddfb721f337 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:31.197204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-43434c33-6c95-4da6-a5db-0ddfb721f337 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:31.261489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-43434c33-6c95-4da6-a5db-0ddfb721f337 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:31.269805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-43434c33-6c95-4da6-a5db-0ddfb721f337 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:31.271271 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-43434c33-6c95-4da6-a5db-0ddfb721f337 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:31.272401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-43434c33-6c95-4da6-a5db-0ddfb721f337 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1281 microversion: 2.20 time: 0.081481 Sep 08 20:06:31.272956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 522/1013] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:31 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:31.426462 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:31.427237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:31.433625 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:31.434202 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:31.434756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:31.435527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:31.436149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:31.436646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:31.571756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:31.580892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-62588b56-0d48-4fde-9455-efeb605bd83a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.158551 Sep 08 20:06:31.581634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 492/1014] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:31 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:32.298218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:32.299410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:32.306670 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:32.307242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:32.307671 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:32.308367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:32.308815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:32.309322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:32.604107 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:32.604692 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:32.611888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:32.612388 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:32.612828 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:32.613531 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:32.613994 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:32.614420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:32.646353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:32.654960 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:32.656375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:32.657477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-87356253-6d57-494a-813b-22fa2d7d92f6 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1333 microversion: 2.20 time: 0.364056 Sep 08 20:06:32.671664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 523/1015] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:32 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1333 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:32.780186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:32.791460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-079be0a0-dc1c-4cf5-82b6-411a54c933bc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.191237 Sep 08 20:06:32.792150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 493/1016] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:32 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:33.684548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:33.685145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:33.691774 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:33.692268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:33.692698 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:33.693398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:33.693840 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:33.694259 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:33.817348 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:33.818945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:33.828528 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:33.829024 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:33.829501 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:33.830215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:33.830761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:33.831189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:33.937833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:33.946932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:33.949158 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:33.950539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-69abb66f-5098-4195-9e19-36d439913638 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.270116 Sep 08 20:06:33.967159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 524/1017] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:33 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:33.998077 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:34.005922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fae3d497-085d-46c2-8324-c3fa2524b779 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.195895 Sep 08 20:06:34.006490 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 494/1018] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:33 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:34.336137 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-fe0d90eb-8b1f-4699-ace1-402c2920adcf req-e128364c-e720-44a8-b27b-1fa2a2f8d016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:34.346995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-fe0d90eb-8b1f-4699-ace1-402c2920adcf req-e128364c-e720-44a8-b27b-1fa2a2f8d016 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:34.347562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-fe0d90eb-8b1f-4699-ace1-402c2920adcf req-e128364c-e720-44a8-b27b-1fa2a2f8d016 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:34.348027 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-fe0d90eb-8b1f-4699-ace1-402c2920adcf req-e128364c-e720-44a8-b27b-1fa2a2f8d016 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:34.359706 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-fe0d90eb-8b1f-4699-ace1-402c2920adcf req-e128364c-e720-44a8-b27b-1fa2a2f8d016 service nova] Creating event network-changed:b4d49a84-5382-401b-8642-316c0610553c for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b on hv-cinder-83124 Sep 08 20:06:34.364404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-fe0d90eb-8b1f-4699-ace1-402c2920adcf req-e128364c-e720-44a8-b27b-1fa2a2f8d016 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032571 Sep 08 20:06:34.364994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 525/1019] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:34.981037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:34.982287 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:34.993585 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:34.994397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:34.995262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:34.996307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:34.997069 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:34.997780 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:35.029817 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:35.030522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:35.037234 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:35.037951 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:35.038390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:35.039131 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:35.039590 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:35.040014 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:35.129936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:35.138232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:35.139830 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:35.140949 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-58009e92-9013-4db7-bb18-afa05f2db068 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.166562 Sep 08 20:06:35.141513 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 495/1020] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:34 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:35.172836 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:35.181363 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d8353021-4758-4768-af5b-e2b8f36d11dd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.156502 Sep 08 20:06:35.181900 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 526/1021] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:35 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:36.169145 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:36.170178 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:36.177269 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:36.177751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:36.178178 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:36.178901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:36.179345 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:36.179762 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:36.212094 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:36.212790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:36.219782 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:36.220349 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:36.220789 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:36.221489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:36.221950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:36.222378 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:36.315743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:36.324212 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:36.325637 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:36.326821 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f9a22d92-1398-463a-8299-266c0c72fb97 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.164212 Sep 08 20:06:36.327382 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 496/1022] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:36 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:36.351947 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:36.359726 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c45cf8d4-1e5a-496c-9a12-5aee49d7a5f4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.151495 Sep 08 20:06:36.360285 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 527/1023] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:36 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:37.351609 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:37.352150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:37.358990 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:37.359476 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:37.360024 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:37.360718 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:37.361169 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:37.361584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:37.382617 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:37.383300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:37.389796 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:37.390288 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:37.390749 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:37.391475 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:37.391940 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:37.392359 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:37.494059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:37.502297 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:37.503729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:37.504836 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e28cc2fa-b779-4f12-971c-5473f7199e43 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.157242 Sep 08 20:06:37.505366 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 497/1024] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:37 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:37.525818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:37.533773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-bae46e66-052f-48f6-b103-e6d9016d098a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.155098 Sep 08 20:06:37.534346 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 528/1025] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:37 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 20:06:38.534291 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:38.535199 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:38.546432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:38.547286 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:38.547997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:38.549123 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:38.549868 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:38.550573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:38.560042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:38.561045 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:38.563794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:38.570325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:38.570852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:38.571287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:38.571986 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:38.572444 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:38.572871 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:38.691415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:38.699515 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:38.700945 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:38.702498 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-70343bc3-1210-425c-b431-a036a8d7a882 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.174882 Sep 08 20:06:38.703227 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 498/1026] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:38 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:38.704153 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:38.712414 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ba4890d4-29dd-4d17-bdd1-37f34429973f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.158709 Sep 08 20:06:38.712986 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 529/1027] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:38 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:39.460176 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-f518d128-71e6-47c9-a8c6-cbe9b9796da1 req-aad4365b-2a60-4983-8cb1-83a35ecbd49f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "name": "network-vif-plugged", "status": "completed", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:39.469660 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-f518d128-71e6-47c9-a8c6-cbe9b9796da1 req-aad4365b-2a60-4983-8cb1-83a35ecbd49f service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:39.470456 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-f518d128-71e6-47c9-a8c6-cbe9b9796da1 req-aad4365b-2a60-4983-8cb1-83a35ecbd49f service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:39.471098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-f518d128-71e6-47c9-a8c6-cbe9b9796da1 req-aad4365b-2a60-4983-8cb1-83a35ecbd49f service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:39.482873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-f518d128-71e6-47c9-a8c6-cbe9b9796da1 req-aad4365b-2a60-4983-8cb1-83a35ecbd49f service nova] Creating event network-vif-plugged:b4d49a84-5382-401b-8642-316c0610553c for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b on hv-cinder-83124 Sep 08 20:06:39.488020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-f518d128-71e6-47c9-a8c6-cbe9b9796da1 req-aad4365b-2a60-4983-8cb1-83a35ecbd49f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088166 Sep 08 20:06:39.488601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 499/1028] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:39.727393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:39.727966 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:39.735193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:39.735807 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:39.736288 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:39.737041 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:39.737200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:39.737929 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:39.743527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:39.743989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:39.744352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:39.745532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:39.745779 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:39.746502 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:39.746991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:39.747421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:39.880937 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:39.885570 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:39.889195 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:39.890628 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:39.891923 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8d971208-d00f-4089-a333-3b6b29e15852 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.168432 Sep 08 20:06:39.892661 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 530/1029] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:39 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:39.897280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a3b88698-d5e3-4c99-bd6a-fb52dd74af7d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.165331 Sep 08 20:06:39.897855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 500/1030] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:39 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:40.920755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:40.921826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:40.923304 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:40.924478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:40.932668 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:40.933869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:40.934564 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:40.935647 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:40.935864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:40.936570 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:40.936811 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:40.937227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:40.937748 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:40.939037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:40.939916 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:40.940733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:40.960357 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:41.073353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:41.073948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:41.081900 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5a42d0c7-4644-47ff-87e5-e9298842d763 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.165164 Sep 08 20:06:41.082284 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:41.089822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 501/1031] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:40 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:41.090013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:41.090013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-aef74a03-5dc5-47ec-a5f3-e98b666e51b5 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1407 microversion: 2.20 time: 0.171461 Sep 08 20:06:41.090013 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 531/1032] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:40 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:41.506028 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-5660d814-c1f2-4f37-9067-088f9fe6a875 req-75f5cb13-4bbe-40a8-976a-11f7e81cdf36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5c169e-c871-4979-9342-b3a5c96770a4", "name": "network-vif-plugged", "status": "completed", "tag": "152189bb-1eba-44b5-a0eb-5d9fbbb86b5d"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:41.510991 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:41.511657 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=8 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:41.518352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5660d814-c1f2-4f37-9067-088f9fe6a875 req-75f5cb13-4bbe-40a8-976a-11f7e81cdf36 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:41.519390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5660d814-c1f2-4f37-9067-088f9fe6a875 req-75f5cb13-4bbe-40a8-976a-11f7e81cdf36 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:41.519390 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-5660d814-c1f2-4f37-9067-088f9fe6a875 req-75f5cb13-4bbe-40a8-976a-11f7e81cdf36 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:41.530855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-5660d814-c1f2-4f37-9067-088f9fe6a875 req-75f5cb13-4bbe-40a8-976a-11f7e81cdf36 service nova] Creating event network-vif-plugged:152189bb-1eba-44b5-a0eb-5d9fbbb86b5d for instance 7a5c169e-c871-4979-9342-b3a5c96770a4 on hv-cinder-83124 Sep 08 20:06:41.535778 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-5660d814-c1f2-4f37-9067-088f9fe6a875 req-75f5cb13-4bbe-40a8-976a-11f7e81cdf36 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 Sep 08 20:06:41.536408 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 502/1033] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:42.106977 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:42.107539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:42.109420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=12 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:42.111205 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:42.111908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:42.115822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:42.116313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:42.116752 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:42.117931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:42.118413 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:42.118670 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:42.118865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:42.119174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:42.119607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:42.120302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:42.120758 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:42.121179 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:42.137447 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:06:42.253009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:42.255134 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:42.261393 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-019ce0fc-5106-4b4b-bc89-cac545142472 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1265 microversion: 2.1 time: 0.159897 Sep 08 20:06:42.262059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 532/1034] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:42 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:42.263761 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:42.265200 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:42.266398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-a05351ab-cca2-4190-95af-b65a5f08fa3c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1598 microversion: 2.20 time: 0.159932 Sep 08 20:06:42.266948 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 503/1035] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:06:42 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1598 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:06:42.290388 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:42.290913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:42.296933 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:42.297424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:42.297866 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:42.298563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:42.299048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:42.299477 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:42.395713 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-466bfec9-44fe-43a9-90a9-41a1e2cb495d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108625 Sep 08 20:06:42.396681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 533/1036] 10.222.0.44 () {60 vars in 1316 bytes} [Thu Sep 8 20:06:42 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:06:43.284810 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:43.285483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:43.292942 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:43.293421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:43.293837 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:43.294556 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:43.295161 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:43.295564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:43.330017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-85ad03ef-8acb-4ca5-8a18-e37511eb1b90 req-709ed770-301f-43c6-be6d-27da2ed6b61e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:43.340057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-85ad03ef-8acb-4ca5-8a18-e37511eb1b90 req-709ed770-301f-43c6-be6d-27da2ed6b61e service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:43.340540 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-85ad03ef-8acb-4ca5-8a18-e37511eb1b90 req-709ed770-301f-43c6-be6d-27da2ed6b61e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:43.340970 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-85ad03ef-8acb-4ca5-8a18-e37511eb1b90 req-709ed770-301f-43c6-be6d-27da2ed6b61e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:43.353695 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-85ad03ef-8acb-4ca5-8a18-e37511eb1b90 req-709ed770-301f-43c6-be6d-27da2ed6b61e service nova] Creating event network-changed:b4d49a84-5382-401b-8642-316c0610553c for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b on hv-cinder-83124 Sep 08 20:06:43.359175 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-85ad03ef-8acb-4ca5-8a18-e37511eb1b90 req-709ed770-301f-43c6-be6d-27da2ed6b61e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 Sep 08 20:06:43.359796 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 534/1037] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:06:43.445162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:43.453536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3cbb31e2-1e00-4735-be47-0b350509fe8a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1451 microversion: 2.1 time: 0.173068 Sep 08 20:06:43.454125 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 504/1038] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:43 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:43.477446 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:06:43.478151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:06:43.484536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:43.485032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:43.485457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:43.486182 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:43.486633 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:43.487323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:43.695204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:06:43.704247 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-31d70ea8-cbc0-4830-8542-4f3e93cb48c2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1451 microversion: 2.1 time: 0.230957 Sep 08 20:06:43.705802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 535/1039] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:06:43 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:06:45.487359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-0bfd83d2-d776-45ca-9f8d-d7d8b6a95d5f req-004500af-ec24-458e-bcc7-efd680675609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a5c169e-c871-4979-9342-b3a5c96770a4", "tag": "152189bb-1eba-44b5-a0eb-5d9fbbb86b5d"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:06:45.498003 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-0bfd83d2-d776-45ca-9f8d-d7d8b6a95d5f req-004500af-ec24-458e-bcc7-efd680675609 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:06:45.498861 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-0bfd83d2-d776-45ca-9f8d-d7d8b6a95d5f req-004500af-ec24-458e-bcc7-efd680675609 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:06:45.499372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-0bfd83d2-d776-45ca-9f8d-d7d8b6a95d5f req-004500af-ec24-458e-bcc7-efd680675609 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:06:45.514010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-0bfd83d2-d776-45ca-9f8d-d7d8b6a95d5f req-004500af-ec24-458e-bcc7-efd680675609 service nova] Creating event network-changed:152189bb-1eba-44b5-a0eb-5d9fbbb86b5d for instance 7a5c169e-c871-4979-9342-b3a5c96770a4 on hv-cinder-83124 Sep 08 20:06:45.519466 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-0bfd83d2-d776-45ca-9f8d-d7d8b6a95d5f req-004500af-ec24-458e-bcc7-efd680675609 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095058 Sep 08 20:06:45.520071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 505/1040] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:07:57.110048 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:07:57.111138 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=14 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:07:57.178268 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:07:57.178980 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:07:57.188164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:07:57.188828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:07:57.189369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:07:57.190098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:07:57.190561 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:07:57.191023 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:07:57.215766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9ee44b3d-fccd-42f4-9f53-c8b77517d7bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/ips" status: 200 len: 150 microversion: 2.20 time: 0.109378 Sep 08 20:07:57.216332 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 536/1041] 10.222.0.44 () {60 vars in 1289 bytes} [Thu Sep 8 20:07:57 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/ips => generated 150 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:07:59.049377 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:07:59.050559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=18 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:07:59.057163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:07:59.057781 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:07:59.065134 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:07:59.065643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:07:59.066081 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:07:59.066790 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:07:59.067241 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:07:59.067665 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:07:59.091848 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lazy-loading 'flavor' on Instance uuid 392fd03d-b76f-49a4-a965-2bb41b0c011b {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:07:59.284449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f188bb4a-cc5f-4561-b4fd-aa372b1bccdc tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/action" status: 202 len: 0 microversion: 2.20 time: 0.238535 Sep 08 20:07:59.285039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 506/1042] 10.222.0.44 () {62 vars in 1319 bytes} [Thu Sep 8 20:07:59 2022] POST /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:07:59.293344 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:07:59.293971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:07:59.301093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:07:59.301491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:07:59.301969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:07:59.302677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:07:59.303123 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:07:59.303595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:07:59.438927 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:07:59.447260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:07:59.448685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:07:59.449833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-30540f12-709d-4c6a-b0df-d16ed5afcb66 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.160496 Sep 08 20:07:59.450401 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 537/1043] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:07:59 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:00.480903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:00.482051 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:00.493954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:00.494465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:00.495888 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:00.496642 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:00.497129 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:00.497563 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:00.644411 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:00.653119 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:00.654471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:00.655651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1e50beee-e562-43b2-92ec-7ac7eea534bb tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.182904 Sep 08 20:08:00.656208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 507/1044] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:00 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:01.682950 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:01.683854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:01.695442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:01.696147 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:01.696563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:01.697294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:01.697739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:01.698160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:01.836409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:01.849457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:01.851632 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:01.853057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-87ff8fce-d424-4ec3-88ef-cde4116e0132 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.175929 Sep 08 20:08:01.853608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 538/1045] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:01 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:02.882734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:02.883731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:02.895064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:02.895870 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:02.896589 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:02.897730 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:02.898482 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:02.899241 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:03.049098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:03.057877 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:03.059427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:03.060602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6bd6ece5-67a1-4e6b-958f-694e1a3f5048 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.184612 Sep 08 20:08:03.061173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 508/1046] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:02 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:04.087594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:04.088278 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:04.095329 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:04.095903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:04.096228 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:04.096939 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:04.097511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:04.097925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:04.236032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:04.244777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:04.246255 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:04.247453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f49bab0c-f75a-441e-8efc-f824c10fb97e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.164979 Sep 08 20:08:04.247986 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 539/1047] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:04 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:05.276818 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:05.277833 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:05.286547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:05.287233 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:05.287798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:05.288705 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:05.289303 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:05.289854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:05.426316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:05.434882 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:05.436287 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:05.437470 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-83297031-2a7f-4f79-80cd-67523823acca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.167329 Sep 08 20:08:05.438018 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 509/1048] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:05 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:06.462897 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:06.463559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:06.473681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:06.474316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:06.475067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:06.476099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:06.476559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:06.476985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:06.621289 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:06.629606 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:06.631034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:06.632196 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-95001869-baaf-498b-95c6-848b6c8ffb4e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.173314 Sep 08 20:08:06.632754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 540/1049] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:06 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:07.660488 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:07.661532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:07.672312 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:07.673103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:07.673826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:07.675011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:07.675767 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:07.676467 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:07.822975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:07.831667 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:07.833098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:07.834270 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4dc6d13d-b62e-4935-a59d-83ef00288a5d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.180472 Sep 08 20:08:07.834884 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 510/1050] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:07 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:08.864297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:08.865497 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:08.876593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:08.877410 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:08.878133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:08.879340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:08.880104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:08.880815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:09.015512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:09.023864 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:09.025292 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:09.026505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-74c8ac3c-63a1-4a0e-92ee-2935055f82ca tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.168926 Sep 08 20:08:09.027103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 541/1051] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:08 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:10.055639 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:10.056545 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:10.067038 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:10.067852 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:10.068573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:10.069712 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:10.070466 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:10.071210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:10.212149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:10.224483 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:10.226757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:10.228471 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0aecb900-7bb7-4a59-b0b5-059688db8205 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.179629 Sep 08 20:08:10.229215 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 511/1052] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:10 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:11.259305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:11.260315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:11.271249 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:11.272056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:11.272780 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:11.273927 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:11.274714 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:11.275434 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:11.412868 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:11.421511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:11.422855 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:11.424019 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ca3b2ae0-c143-4097-86b4-02b04e10042e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.171336 Sep 08 20:08:11.424647 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 542/1053] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:11 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:12.452678 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:12.453298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:12.460368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:12.460853 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:12.461282 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:12.461968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:12.462418 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:12.462872 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:12.601534 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:12.610125 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:12.611573 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:12.612731 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-70f9d113-89fb-473d-814d-8b6f186bee62 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.165996 Sep 08 20:08:12.613258 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 512/1054] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:12 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:13.647408 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:13.647973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:13.655066 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:13.655545 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:13.655973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:13.656658 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:13.657136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:13.657551 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:13.849071 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:13.857422 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:13.858917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:13.860069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-53f357a3-7e67-44fc-99d6-c8cba13cc133 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.216602 Sep 08 20:08:13.860615 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 543/1055] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:13 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:14.885907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:14.886539 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:14.894326 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:14.894951 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:14.895387 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:14.896085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:14.896713 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:14.897138 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:15.031121 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:15.039829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:15.041257 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:15.042420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-92949caf-43d2-4933-9801-c9309dab3572 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.160508 Sep 08 20:08:15.043031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 513/1056] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:14 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:16.070188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:16.072243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:16.080982 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:16.081469 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:16.081905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:16.082619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:16.083163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:16.083585 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:16.218524 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:16.232102 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:16.234460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:16.236160 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4571e35b-f395-4bc9-a50c-df48da0d961a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1743 microversion: 2.20 time: 0.171365 Sep 08 20:08:16.236690 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 544/1057] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:16 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:17.265850 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:17.267131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:17.278085 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:17.278940 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:17.279655 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:17.280790 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:17.281536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:17.282380 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:17.412864 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:17.421621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:17.423446 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:17.424806 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3850f007-fb72-48e0-8d80-1b835e5f4c82 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1743 microversion: 2.20 time: 0.165491 Sep 08 20:08:17.425415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 514/1058] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:17 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:18.453868 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:18.454601 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:18.461180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:18.461673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:18.462105 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:18.462837 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:18.463296 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:18.463720 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:18.755177 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:18.763800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:18.765232 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:18.766398 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-76f01515-c3a7-482b-b767-1c4a1b0cc212 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1743 microversion: 2.20 time: 0.319482 Sep 08 20:08:18.767017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 545/1059] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:18 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1743 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:19.734171 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-1b9cf492-b04a-44e1-bb9f-e005ec1ab9e0 req-55ee8f7f-1589-41b3-a34f-e993d341e77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "name": "network-vif-plugged", "status": "completed", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:08:19.745461 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-1b9cf492-b04a-44e1-bb9f-e005ec1ab9e0 req-55ee8f7f-1589-41b3-a34f-e993d341e77b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:19.745756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-1b9cf492-b04a-44e1-bb9f-e005ec1ab9e0 req-55ee8f7f-1589-41b3-a34f-e993d341e77b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:19.746187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-1b9cf492-b04a-44e1-bb9f-e005ec1ab9e0 req-55ee8f7f-1589-41b3-a34f-e993d341e77b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:19.757812 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-1b9cf492-b04a-44e1-bb9f-e005ec1ab9e0 req-55ee8f7f-1589-41b3-a34f-e993d341e77b service nova] Creating event network-vif-plugged:b4d49a84-5382-401b-8642-316c0610553c for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b on hv-cinder-83124 Sep 08 20:08:19.762978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-1b9cf492-b04a-44e1-bb9f-e005ec1ab9e0 req-55ee8f7f-1589-41b3-a34f-e993d341e77b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Sep 08 20:08:19.763557 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 515/1060] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:08:19.791634 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:19.792277 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:19.799421 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:19.799914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:19.800347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:19.801056 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:19.801512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:19.801948 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:19.932992 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:19.941800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:19.943243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:19.944397 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-dd62bf8b-bf18-489a-897a-4f75bd7604bf tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1743 microversion: 2.20 time: 0.156679 Sep 08 20:08:19.944949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 546/1061] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:19 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:20.970675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:20.971385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:20.977986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:20.978466 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:20.978938 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:20.979629 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:20.980076 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:20.980495 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:21.115953 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:21.124997 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:21.126546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:21.127780 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e81b358d-b0dd-4e4f-98a4-1cc67f443372 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.162098 Sep 08 20:08:21.128336 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 516/1062] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:20 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:22.152438 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:22.153147 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:22.161583 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:22.162360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:22.162800 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:22.163685 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:22.164302 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:22.164892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:22.315751 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:22.324263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:22.326018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:22.327429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-43290f7b-cc09-4e4b-a3eb-5d316c1fcd90 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.178995 Sep 08 20:08:22.327976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 547/1063] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:22 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:23.354559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:23.355965 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:23.363211 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:23.364082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:23.364741 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:23.366064 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:23.366796 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:23.367433 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:23.515624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:23.524837 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:23.526677 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:23.527939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f18f1c33-f771-4d07-bf8b-1d6bc61b943b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.178628 Sep 08 20:08:23.543009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 517/1064] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:23 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:24.555429 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:24.556176 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:24.563334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:24.563824 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:24.564242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:24.565120 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:24.565946 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:24.566375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:24.713595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:24.726355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:24.728004 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:24.729320 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c44803c5-c10f-467f-af3a-d6ca01af6cf0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.178379 Sep 08 20:08:24.729949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 548/1065] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:24 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:25.755843 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:25.756691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:25.764478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:25.765086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:25.765708 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:25.766686 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:25.767217 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:25.767707 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:25.924103 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:25.933209 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:25.934628 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:25.935878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1f0f569d-449e-4bc1-a06d-8826d6ab7ba7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.184373 Sep 08 20:08:25.947109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 518/1066] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:25 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:26.961611 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:26.962500 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:26.969274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:26.969903 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:26.970420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:26.971213 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:26.971712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:26.972399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:27.111198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:27.120170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:27.121716 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:27.123032 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-831d681a-9228-4467-a616-8da8476e4895 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.165323 Sep 08 20:08:27.123823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 549/1067] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:26 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:28.148931 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:28.150231 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:28.157364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:28.157856 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:28.158290 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:28.159006 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:28.159459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:28.159880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:28.309469 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:28.320365 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:28.322014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:28.323778 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f27c1926-8f08-46b8-880c-85753f318cc8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.179150 Sep 08 20:08:28.326749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 519/1068] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:28 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:29.350211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:29.352291 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:29.353433 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=29 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:08:29.359421 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:29.363333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:29.363333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:29.363333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:29.363333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:29.363737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:29.365501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=83 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:08:29.509565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:29.518161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:29.519648 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:29.520815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-447b659b-a737-43cb-bc3c-518402ac8719 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.174651 Sep 08 20:08:29.521594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 550/1069] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:29 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:30.549548 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:30.550250 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:30.552933 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=29 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:08:30.559059 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:30.559574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:30.560077 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:30.560829 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:30.561325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:30.561785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:30.564842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:08:30.717983 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:30.726595 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:30.728061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:30.729236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0239285a-e63e-45c9-a1e5-11b80e7808c9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1738 microversion: 2.20 time: 0.185999 Sep 08 20:08:30.729784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 520/1070] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:30 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:31.754673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:31.755297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:31.762325 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:31.762860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:31.763340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:31.764075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:31.764531 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:31.764961 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:31.924118 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:31.932674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:31.934110 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:31.935308 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-04b39c40-f22a-4f96-9172-60ba48b014a7 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1720 microversion: 2.20 time: 0.184663 Sep 08 20:08:31.935897 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 551/1071] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:31 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:32.960957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:32.961555 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:32.968785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:32.969284 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:32.969765 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:32.970464 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:32.970946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:32.971371 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:33.105773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:33.114187 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:33.116001 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:33.117173 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0d4df53c-108d-4d5e-a19b-12aaa9cb7fe8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1720 microversion: 2.20 time: 0.160171 Sep 08 20:08:33.117701 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 521/1072] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:32 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:33.761860 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-e2136c4b-b8f7-42a1-8553-ec6252112e30 req-85524f3b-8aca-4821-b2e0-7dd651b81a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "name": "network-vif-unplugged", "status": "completed", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:08:33.772468 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-e2136c4b-b8f7-42a1-8553-ec6252112e30 req-85524f3b-8aca-4821-b2e0-7dd651b81a82 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:33.772944 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-e2136c4b-b8f7-42a1-8553-ec6252112e30 req-85524f3b-8aca-4821-b2e0-7dd651b81a82 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:33.773369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-e2136c4b-b8f7-42a1-8553-ec6252112e30 req-85524f3b-8aca-4821-b2e0-7dd651b81a82 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:33.784732 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.compute.server_external_events [req-e2136c4b-b8f7-42a1-8553-ec6252112e30 req-85524f3b-8aca-4821-b2e0-7dd651b81a82 service nova] Unable to find a host for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b. Dropping event network-vif-unplugged {{(pid=120484) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 20:08:33.785608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-e2136c4b-b8f7-42a1-8553-ec6252112e30 req-85524f3b-8aca-4821-b2e0-7dd651b81a82 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027620 Sep 08 20:08:33.786188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 552/1073] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 20:08:34.143903 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:34.144543 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:34.151417 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:34.151904 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:34.152336 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:34.153022 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:34.153477 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:34.153993 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:34.292839 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:34.301673 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:34.303148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:34.304294 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d2887fd3-4a22-4bf3-be61-5ddf12d1276b tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1663 microversion: 2.20 time: 0.165125 Sep 08 20:08:34.304857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 522/1074] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:34 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:34.329358 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01ce0484-5659-4463-8c53-f244aa72590f"}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:08:34.331837 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:34.338331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:34.338865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:34.339304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:34.340000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:34.340458 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:34.340887 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:34.675324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d5d91d01-582d-4903-99a8-571d9bbc4d2d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349881 Sep 08 20:08:34.675958 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 553/1075] 10.222.0.44 () {62 vars in 1364 bytes} [Thu Sep 8 20:08:34 2022] POST /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 20:08:34.812174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:34.812646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:34.819405 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:34.820193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:34.820622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:34.821307 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:34.821756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:34.822174 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:35.067372 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7a7c64cf-4965-4b4f-a1d6-13f7d6915470 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments/01ce0484-5659-4463-8c53-f244aa72590f" status: 202 len: 0 microversion: 2.20 time: 0.258666 Sep 08 20:08:35.068206 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 523/1076] 10.222.0.44 () {60 vars in 1457 bytes} [Thu Sep 8 20:08:34 2022] DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments/01ce0484-5659-4463-8c53-f244aa72590f => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 20:08:35.145264 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:08:35.145877 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:35.153242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:35.153764 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:35.154203 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:35.154941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:35.155424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:35.155855 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:35.185008 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120484) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 20:08:35.257103 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6e6e0080-5622-4f35-86e8-d9345e67f39e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "POST /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/action" status: 202 len: 0 microversion: 2.20 time: 0.116145 Sep 08 20:08:35.257718 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 554/1077] 10.222.0.44 () {62 vars in 1319 bytes} [Thu Sep 8 20:08:35 2022] POST /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:08:35.266048 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:35.266885 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:35.273873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:35.274429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:35.274961 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:35.276095 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:35.276316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:35.276880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:35.408582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:35.417404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:35.418924 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:35.420109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4236ca3e-923d-4756-b3db-d22780dce759 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1671 microversion: 2.20 time: 0.158107 Sep 08 20:08:35.420667 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 524/1078] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:35 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:36.449562 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:36.450593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:36.459152 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:36.459649 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:36.460083 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:36.460789 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:36.461243 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:36.461737 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:36.593594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:36.603390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:36.604809 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:36.605985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-0df8baf4-efc6-4ef5-a9a1-751923100aef tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.163243 Sep 08 20:08:36.606494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 555/1079] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:36 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:37.632922 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:37.633747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:37.641032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:37.641524 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:37.641976 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:37.643038 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:37.643634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:37.644232 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:37.810971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:37.820306 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:37.822383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:37.823978 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ae63450d-d8ff-4ce1-bedc-17b5a7da4dcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.195902 Sep 08 20:08:37.825122 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 525/1080] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:37 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:38.850125 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:38.850755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:38.857610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:38.858067 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:38.858527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:38.859258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:38.859708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:38.860133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:38.997571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:39.006432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:39.007876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:39.009055 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-a6f5e51d-de45-473b-8878-8502cac62690 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.163113 Sep 08 20:08:39.022664 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 556/1081] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:38 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:40.035368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:40.036153 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:40.042314 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:40.042846 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:40.043277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:40.043989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:40.044456 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:40.044880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:40.186053 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:40.194525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:40.195974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:40.197245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b157306c-0017-4423-a0fa-a281f7107e39 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.166129 Sep 08 20:08:40.197805 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 526/1082] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:40 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:41.223655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:41.224409 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:41.231688 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:41.232182 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:41.232618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:41.233404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:41.233861 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:41.234287 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:41.381039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:41.389660 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:41.391127 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:41.392348 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6c2465cc-fe58-4dcb-913d-d7970443c4f2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.173096 Sep 08 20:08:41.401305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 557/1083] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:41 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:42.421401 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:42.422040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:42.429647 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:42.430082 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:42.430514 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:42.431274 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:42.431747 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:42.432148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:42.568300 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:42.577130 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:42.578576 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:42.579777 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-68d8d314-1669-448a-88c3-0159ca98aef2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.162349 Sep 08 20:08:42.580330 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 527/1084] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:42 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:43.604818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:43.605536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:43.612274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:43.612778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:43.613211 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:43.613932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:43.615453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:43.615902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:43.766343 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:43.775314 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:43.776754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:43.777943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-31c2784b-39fb-4212-9b54-2cf93fc9e55e tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.177126 Sep 08 20:08:43.783261 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 558/1085] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:43 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:44.803457 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:44.804055 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:44.811278 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:44.811773 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:44.812219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:44.812913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:44.813364 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:44.813790 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:44.961037 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:44.966547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:44.968132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:44.969236 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-350c6fca-9755-453c-bac6-3267e9543640 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.169798 Sep 08 20:08:44.969802 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 528/1086] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:44 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:45.996161 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:45.996913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:46.005136 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:46.005894 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:46.006326 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:46.007058 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:46.007510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:46.007932 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:46.140889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:46.149491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:46.151143 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:46.152304 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-2164d863-f7f6-4232-a745-969505474318 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.160119 Sep 08 20:08:46.152856 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 559/1087] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:45 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:47.181949 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:47.182995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:47.193493 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:47.193982 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:47.194404 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:47.195131 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:47.195583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:47.195999 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:47.329478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:47.339611 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:47.341039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:47.342182 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-8ce792ba-e1d9-4d46-b25a-03e95b620b87 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.166910 Sep 08 20:08:47.342760 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 529/1088] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:47 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:48.371478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:48.372472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:48.383063 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:48.383869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:48.384595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:48.385745 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:48.386501 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:48.387254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:48.522912 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:48.531527 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:48.532968 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:48.534134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-12d4c9bd-ad61-4663-b102-02f508510665 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.169816 Sep 08 20:08:48.534757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 560/1089] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:48 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:49.564172 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:49.565110 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:49.573016 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:49.573502 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:49.573937 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:49.574676 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:49.575139 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:49.575564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:49.706798 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:49.715736 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:49.717219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:49.718398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-11a7ad3d-2bf3-4a67-bef5-e07babfdac08 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.161001 Sep 08 20:08:49.719011 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 530/1090] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:49 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:50.750954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:50.751534 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:50.758567 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:50.759104 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:50.759547 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:50.760245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:50.760704 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:50.761133 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:50.891121 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:50.899742 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:50.901156 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:50.902316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-aebd1afc-f9df-46b3-b5c7-f68e822cfa8c tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.155405 Sep 08 20:08:50.902914 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 561/1091] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:50 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:51.928428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:51.929014 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:51.935875 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:51.936362 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:51.936801 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:51.937492 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:51.937989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:51.938410 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:52.071525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:52.079987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:52.081419 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:52.082583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-01fc24a2-dd08-40c6-b69d-cd18d48ec87d tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.158206 Sep 08 20:08:52.083229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 531/1092] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:51 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:53.122754 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:53.123580 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:53.133043 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:53.133533 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:53.133971 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:53.134682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:53.135164 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:53.135600 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:53.281797 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:53.290832 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:53.292253 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:53.293432 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-14722d75-078f-4bf2-9a81-f3f754184c24 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.177526 Sep 08 20:08:53.294004 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 562/1093] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:53 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:53.924913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-6f006368-4e87-4b35-a8c4-eb446f6d5eac req-56fafd3d-fce4-41e7-8cde-f3e38e2b9e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "name": "network-vif-plugged", "status": "completed", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:08:53.935613 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6f006368-4e87-4b35-a8c4-eb446f6d5eac req-56fafd3d-fce4-41e7-8cde-f3e38e2b9e13 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:53.936192 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6f006368-4e87-4b35-a8c4-eb446f6d5eac req-56fafd3d-fce4-41e7-8cde-f3e38e2b9e13 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:53.936623 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-6f006368-4e87-4b35-a8c4-eb446f6d5eac req-56fafd3d-fce4-41e7-8cde-f3e38e2b9e13 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:53.950524 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-6f006368-4e87-4b35-a8c4-eb446f6d5eac req-56fafd3d-fce4-41e7-8cde-f3e38e2b9e13 service nova] Creating event network-vif-plugged:b4d49a84-5382-401b-8642-316c0610553c for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b on hv-cinder-83124 Sep 08 20:08:53.955634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-6f006368-4e87-4b35-a8c4-eb446f6d5eac req-56fafd3d-fce4-41e7-8cde-f3e38e2b9e13 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034507 Sep 08 20:08:53.956265 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 532/1094] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:08:54.322517 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:54.323426 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:54.334052 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:54.334512 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:54.335000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:54.335711 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:54.336146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:54.336576 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:54.468605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:54.470887 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:08:54.478215 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:54.479672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:54.480842 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-69546b46-9f97-448e-a631-c39b335e4379 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.165032 Sep 08 20:08:54.481394 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 563/1095] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:54 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:55.512098 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:55.513243 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:55.523737 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:55.524548 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:55.525264 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:55.526414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:55.527208 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:55.527905 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:55.661601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:55.669966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:55.671459 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:55.672599 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-9ccdf0d1-f6c1-44eb-becd-85c7fd2b7c20 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1729 microversion: 2.20 time: 0.168951 Sep 08 20:08:55.673163 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 533/1096] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:55 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:08:56.703030 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:08:56.704017 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:08:56.713159 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:56.713673 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:56.714098 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:56.714831 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:08:56.715284 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:08:56.715699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:08:56.853060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:56.865766 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:56.867865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:08:56.869594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-61febc8f-a4ec-4fd9-8b93-fdb18f8bffcd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1716 microversion: 2.20 time: 0.174253 Sep 08 20:08:56.870404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 564/1097] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:08:56 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:09:00.460475 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:00.461087 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:00.467751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:00.468233 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:00.468664 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:00.469358 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:00.469822 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:00.470242 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:00.497032 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:09:00.499913 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:00.566353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=32 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:00.579195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ca91c45b-44f0-45cf-bf01-9a3fb9fe53a6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 204 len: 0 microversion: 2.1 time: 0.122206 Sep 08 20:09:00.580157 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 534/1098] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:09:00 2022] DELETE /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 20:09:00.588869 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:00.589596 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:00.592000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:00.597581 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:00.598072 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:00.598504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:00.599225 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:00.599808 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:00.600227 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:00.733471 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:00.742069 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9bdf5944-a735-41ab-95ad-53b0d5e3966e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1575 microversion: 2.1 time: 0.157127 Sep 08 20:09:00.742676 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 565/1099] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:00 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:01.766975 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:01.767866 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:01.775440 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:01.775954 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:01.776368 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:01.777073 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:01.777545 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:01.777966 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:01.923359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:01.935042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c7d2fb68-d2c4-4d5a-b410-58da766e855a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1575 microversion: 2.1 time: 0.172548 Sep 08 20:09:01.935928 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 535/1100] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:01 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:02.959229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:02.959888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:02.966893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:02.967318 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:02.967752 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:02.968431 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:02.968881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:02.969522 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:03.060208 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:03.068755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-5a6921e8-de43-48a4-a3f2-b9858e092302 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1507 microversion: 2.1 time: 0.113402 Sep 08 20:09:03.069315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 566/1101] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:02 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1507 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:03.448612 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-89a2286b-5f00-4c9d-a6aa-7d13221a3f82 req-284b63f0-c305-4ab9-bcd9-37c55de33a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a5c169e-c871-4979-9342-b3a5c96770a4", "name": "network-vif-deleted", "tag": "152189bb-1eba-44b5-a0eb-5d9fbbb86b5d"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:09:03.458743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-89a2286b-5f00-4c9d-a6aa-7d13221a3f82 req-284b63f0-c305-4ab9-bcd9-37c55de33a10 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:03.459220 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-89a2286b-5f00-4c9d-a6aa-7d13221a3f82 req-284b63f0-c305-4ab9-bcd9-37c55de33a10 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:03.459643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-89a2286b-5f00-4c9d-a6aa-7d13221a3f82 req-284b63f0-c305-4ab9-bcd9-37c55de33a10 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:03.471298 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-89a2286b-5f00-4c9d-a6aa-7d13221a3f82 req-284b63f0-c305-4ab9-bcd9-37c55de33a10 service nova] Creating event network-vif-deleted:152189bb-1eba-44b5-a0eb-5d9fbbb86b5d for instance 7a5c169e-c871-4979-9342-b3a5c96770a4 on hv-cinder-83124 Sep 08 20:09:03.476883 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-89a2286b-5f00-4c9d-a6aa-7d13221a3f82 req-284b63f0-c305-4ab9-bcd9-37c55de33a10 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031987 Sep 08 20:09:03.477814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 536/1102] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:09:04.093281 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:04.093892 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:04.102093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:04.102571 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:04.103314 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:04.104022 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:04.104770 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:04.105220 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:04.150377 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:04.150916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:04.151359 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:04.151826 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.objects.instance [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lazy-loading 'fault' on Instance uuid 7a5c169e-c871-4979-9342-b3a5c96770a4 {{(pid=120484) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:09:04.202207 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:04.211353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d3e20aeb-ceee-4490-bf1a-b31e8e31015a tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 200 len: 1183 microversion: 2.1 time: 0.122104 Sep 08 20:09:04.214865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 567/1103] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:04 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 1183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:05.241936 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:05.243063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:05.249733 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:05.250235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:05.250684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:05.251394 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:05.251844 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:05.252271 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:05.265853 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] HTTP exception thrown: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Request method failure captured: Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 HTTP/1.1 Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGksnGO1UL2uWK58j4DO4TjJmZXa0cbwUSunMAL1mTh-_ekgO6AxuJKNpIMMAr3MOB8UVbY5mEpFsrnjc0VrNSnjX-aNW5K5gHHyBZX4kws3_l2bTc6JBB1L4RdRuFrKV8Smzkc1-GTDySOlNniepLVLLHox2npBp_aV7gyt5F8noDjg Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:09:05.267564 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3020f7128e9e434d82b72b9760db31ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-TestVolumeBootPattern-496719835 Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: cb5ed38c1e2640919b16746d42494d65 Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:09:05.269186 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '7a5c169e-c871-4979-9342-b3a5c96770a4'} Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:09:05.270223 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:09:05.272061 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:05.273511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Returning 404 to user: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:09:05.273511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-f24c8cc7-1d5c-418f-8c07-cbfaa2876fec tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 404 len: 111 microversion: 2.1 time: 0.035369 Sep 08 20:09:05.273511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 537/1104] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:05 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:09:05.318218 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1727042786", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-202422694", "security_groups": [{"name": "tempest-secgroup-smoke-1476250419"}], "block_device_mapping_v2": [{"uuid": "bd536582-9bd6-4c4c-b3a8-1f9ebe21e705", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da0828a8-6f51-4654-9c86-6904ed730ff8"}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:09:05.442922 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] validate_networks() for [('da0828a8-6f51-4654-9c86-6904ed730ff8', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:09:05.823295 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:09:05.823729 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:09:05.824399 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:09:05.824979 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:09:05.825482 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:09:05.839383 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:05.840042 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:05.840600 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:05.842096 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:05.842761 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:05.843352 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:05.863327 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for project 3020f7128e9e434d82b72b9760db31ba. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:09:05.867814 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for user cb5ed38c1e2640919b16746d42494d65 and project 3020f7128e9e434d82b72b9760db31ba. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:09:05.928931 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:09:05.931290 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd536582-9bd6-4c4c-b3a8-1f9ebe21e705',volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:09:06.064655 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7111899c-5370-4c9e-b85d-6e541d933a6e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750349 Sep 08 20:09:06.065297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 568/1105] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 20:09:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 20:09:06.076917 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-090d1efa-76da-4d6a-b78e-d47116a8baa2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:06.077995 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-090d1efa-76da-4d6a-b78e-d47116a8baa2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:06.136568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-090d1efa-76da-4d6a-b78e-d47116a8baa2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:06.143980 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-090d1efa-76da-4d6a-b78e-d47116a8baa2 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1094 microversion: 2.1 time: 0.071067 Sep 08 20:09:06.144535 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 538/1106] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:06 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:07.167537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:07.168144 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:07.175147 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:07.175659 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:07.176099 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:07.176815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:07.177275 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:07.177909 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:07.265537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:07.274681 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-9deee2e0-e527-444e-ba0f-291f66330abd tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1210 microversion: 2.1 time: 0.111632 Sep 08 20:09:07.275443 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 569/1107] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:07 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:08.302195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:08.303349 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:08.313427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:08.313914 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:08.314359 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:08.315454 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:08.315907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:08.316325 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:08.445984 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:08.453924 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c41875fe-365e-4666-8666-a67c7f23b5e9 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.158853 Sep 08 20:09:08.454584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 539/1108] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:08 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:08.526539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-a63002cd-aad3-421f-8233-6ea5e7632e0c req-ebb592d5-ee5a-4c2c-865c-6e8ce0eeb34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081983ce-7706-40ee-a487-1c9c9d85db41", "tag": "39708969-ad79-416e-8d94-fed3e5377a87"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:09:08.538182 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a63002cd-aad3-421f-8233-6ea5e7632e0c req-ebb592d5-ee5a-4c2c-865c-6e8ce0eeb34b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:08.538682 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a63002cd-aad3-421f-8233-6ea5e7632e0c req-ebb592d5-ee5a-4c2c-865c-6e8ce0eeb34b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:08.539115 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-a63002cd-aad3-421f-8233-6ea5e7632e0c req-ebb592d5-ee5a-4c2c-865c-6e8ce0eeb34b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:08.550525 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-a63002cd-aad3-421f-8233-6ea5e7632e0c req-ebb592d5-ee5a-4c2c-865c-6e8ce0eeb34b service nova] Creating event network-changed:39708969-ad79-416e-8d94-fed3e5377a87 for instance 081983ce-7706-40ee-a487-1c9c9d85db41 on hv-cinder-83124 Sep 08 20:09:08.556029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-a63002cd-aad3-421f-8233-6ea5e7632e0c req-ebb592d5-ee5a-4c2c-865c-6e8ce0eeb34b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033944 Sep 08 20:09:08.556638 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 570/1109] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:09:09.482283 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:09.483279 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:09.494162 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:09.495058 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:09.495791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:09.496938 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:09.497740 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:09.498421 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:09.894423 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:09.902575 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-837046e1-260a-4121-b3c2-afcd082cd63d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.426999 Sep 08 20:09:09.903193 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 540/1110] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:09 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:10.931003 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:10.932174 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:10.942896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:10.943712 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:10.944454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:10.945605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:10.946280 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:10.946729 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:11.087604 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:11.099608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7a9d8b4f-0fb3-4b20-9ee9-ba4fcd5d8f85 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.176334 Sep 08 20:09:11.100453 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 571/1111] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:10 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:12.127816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:12.128688 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:12.139838 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:12.140649 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:12.141389 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:12.142518 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:12.143332 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:12.144042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:12.276044 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:12.284234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4f802c54-f44d-4d6f-a9fc-45ba6654deaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.163082 Sep 08 20:09:12.284812 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 541/1112] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:12 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:13.310881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:13.311954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:13.322220 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:13.322734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:13.323187 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:13.323881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:13.324341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:13.324772 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:13.517116 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:13.527741 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-d76262ef-8853-4b15-bde5-0e6ea3e9847f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.223436 Sep 08 20:09:13.528306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 572/1113] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:13 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:14.553602 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:14.554529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:14.562427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:14.562946 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:14.563384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:14.564079 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:14.564532 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:14.564955 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:14.701824 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:14.710296 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1d0964aa-b232-4cec-85da-b73804a2ed58 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.163376 Sep 08 20:09:14.710956 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 542/1114] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:14 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:15.733095 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:15.733689 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:15.740985 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:15.741480 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:15.741915 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:15.742619 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:15.743108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:15.743532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:15.852815 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:15.874110 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=6 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:15.893415 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:15.901563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8450e264-4eb4-4df8-adcd-e705aa2a2160 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.172484 Sep 08 20:09:15.902169 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 573/1115] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:15 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:16.928886 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:16.929892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:16.933807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:16.942607 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:16.943449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:16.944170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:16.945302 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:16.946049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:16.946971 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:17.137710 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:17.146264 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ec5716cf-f5fd-4168-bc91-f1ae4181f02e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.223974 Sep 08 20:09:17.146873 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 543/1116] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:16 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:18.169407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:18.170012 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:18.176778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:18.177294 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:18.177746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:18.178425 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:18.178920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:18.179338 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:18.315756 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:18.326482 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c5a248b8-858d-464f-8b95-0c939f78e085 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.161031 Sep 08 20:09:18.327084 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 574/1117] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:18 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:19.353695 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:19.354631 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:19.362674 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:19.363210 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:19.363646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:19.364699 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:19.365152 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:19.365575 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:19.511896 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:19.523398 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7163775e-2434-466b-92e2-aef83183346e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.175937 Sep 08 20:09:19.524189 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 544/1118] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:19 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:20.025954 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-3cb3a184-6fb6-47cd-821b-bef64e0058df req-ad6a7532-3254-42d2-adf2-3ebae23236ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081983ce-7706-40ee-a487-1c9c9d85db41", "name": "network-vif-plugged", "status": "completed", "tag": "39708969-ad79-416e-8d94-fed3e5377a87"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:09:20.036511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3cb3a184-6fb6-47cd-821b-bef64e0058df req-ad6a7532-3254-42d2-adf2-3ebae23236ab service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:20.036918 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3cb3a184-6fb6-47cd-821b-bef64e0058df req-ad6a7532-3254-42d2-adf2-3ebae23236ab service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:20.037413 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3cb3a184-6fb6-47cd-821b-bef64e0058df req-ad6a7532-3254-42d2-adf2-3ebae23236ab service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:20.049956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-3cb3a184-6fb6-47cd-821b-bef64e0058df req-ad6a7532-3254-42d2-adf2-3ebae23236ab service nova] Creating event network-vif-plugged:39708969-ad79-416e-8d94-fed3e5377a87 for instance 081983ce-7706-40ee-a487-1c9c9d85db41 on hv-cinder-83124 Sep 08 20:09:20.055119 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-3cb3a184-6fb6-47cd-821b-bef64e0058df req-ad6a7532-3254-42d2-adf2-3ebae23236ab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032799 Sep 08 20:09:20.055692 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 575/1119] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:09:20.552396 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:20.553260 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:20.564219 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:20.565020 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:20.565727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:20.566994 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:20.567742 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:20.568430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:20.708669 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:20.716619 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-c6cbeb12-818a-4aac-9a54-b585421b7aaa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.170978 Sep 08 20:09:20.717222 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 545/1120] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:20 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:21.741476 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:21.742326 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:21.750484 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:21.751029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:21.751457 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:21.752157 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:21.752608 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:21.753029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:21.898559 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:21.907397 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-ccdfeb24-c744-49cc-b21f-5406e963eac1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1266 microversion: 2.1 time: 0.171312 Sep 08 20:09:21.907983 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 576/1121] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:21 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:22.933690 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:22.934743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:22.945842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:22.946691 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:22.947420 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:22.948571 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:22.949329 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:22.950031 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:23.085001 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:23.093138 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-4289956e-e21f-43c9-99cf-cda5e506f630 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1452 microversion: 2.1 time: 0.166097 Sep 08 20:09:23.093712 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 546/1122] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:22 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:23.118328 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:23.118995 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:23.127260 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:23.127744 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:23.128188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:23.128917 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:23.129367 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:23.129786 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:23.260353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:23.268312 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8cf95fad-b0fd-4f30-addd-fb2ecae1144f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1452 microversion: 2.1 time: 0.156526 Sep 08 20:09:23.268885 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 577/1123] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:09:23 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:24.897120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-dcdcca3f-0d6c-426a-bc87-20b779a901a9 req-6bc09ab9-a84c-4d6e-ae5e-0301da642a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081983ce-7706-40ee-a487-1c9c9d85db41", "tag": "39708969-ad79-416e-8d94-fed3e5377a87"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:09:24.907437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-dcdcca3f-0d6c-426a-bc87-20b779a901a9 req-6bc09ab9-a84c-4d6e-ae5e-0301da642a93 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:24.907947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-dcdcca3f-0d6c-426a-bc87-20b779a901a9 req-6bc09ab9-a84c-4d6e-ae5e-0301da642a93 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:24.908415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-dcdcca3f-0d6c-426a-bc87-20b779a901a9 req-6bc09ab9-a84c-4d6e-ae5e-0301da642a93 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:24.922757 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-dcdcca3f-0d6c-426a-bc87-20b779a901a9 req-6bc09ab9-a84c-4d6e-ae5e-0301da642a93 service nova] Creating event network-changed:39708969-ad79-416e-8d94-fed3e5377a87 for instance 081983ce-7706-40ee-a487-1c9c9d85db41 on hv-cinder-83124 Sep 08 20:09:24.927968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-dcdcca3f-0d6c-426a-bc87-20b779a901a9 req-6bc09ab9-a84c-4d6e-ae5e-0301da642a93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034544 Sep 08 20:09:24.928624 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 547/1124] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:09:52.292969 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:52.295188 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:52.297389 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:52.298039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=75 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:52.299261 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:09:52.299403 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Thu Sep 8 20:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments (ip 10.222.0.44) !!! Sep 08 20:09:52.309626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:52.310297 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:52.310890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:52.311916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:52.312593 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:52.313222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:52.344949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c153378b-67d3-42ce-b853-90d256202df8 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056189 Sep 08 20:09:52.345478 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 578/1125] 10.222.0.44 () {60 vars in 1343 bytes} [Thu Sep 8 20:09:52 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:09:52.407986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:52.408727 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:09:52.409512 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:09:52.409661 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b (ip 10.222.0.44) !!! Sep 08 20:09:52.410749 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:09:52.410899 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b (ip 10.222.0.44) !!! Sep 08 20:09:52.416447 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:52.417023 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:52.428336 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:52.428814 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:52.429246 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:52.429939 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:52.430381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:52.430826 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:52.458138 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:09:52.536684 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3a98bd46-5cfb-49fc-9f8a-b761da780bc2 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 204 len: 0 microversion: 2.20 time: 0.130096 Sep 08 20:09:52.537269 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 548/1126] 10.222.0.44 () {60 vars in 1280 bytes} [Thu Sep 8 20:09:52 2022] DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 20:09:52.545957 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:52.546574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:52.552861 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:52.553353 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:52.553794 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:52.554495 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:52.555015 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:52.555445 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:52.695474 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:52.703998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:52.705427 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:52.706720 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-31c00522-91e3-443f-8113-30ffd05d430a tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.164809 Sep 08 20:09:52.707274 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 579/1127] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:09:52 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:09:53.736643 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:53.737451 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:53.744656 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:53.745460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:53.745582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:53.746258 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:53.746745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:53.747170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:53.884944 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:53.893392 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:53.894855 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:53.896029 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-15ea2506-8ec2-4534-a067-efa5de639af1 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1722 microversion: 2.20 time: 0.166357 Sep 08 20:09:53.896590 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 549/1128] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:09:53 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:09:54.921757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:54.922428 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:54.929867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:54.930366 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:54.930833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:54.931546 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:54.931998 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:54.932416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:55.210049 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:55.219902 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:55.221315 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e582f450b96c4e37ad88501bfa02441e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5600d866afb84f53882c2a5fb07298b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:09:55.222488 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-f712a15c-393e-482a-8070-e81f053ab72f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 200 len: 1654 microversion: 2.20 time: 0.304780 Sep 08 20:09:55.223565 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 580/1129] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:09:54 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 1654 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 20:09:55.275511 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-010c4455-dad3-46ff-9ebf-2e7f68f5ef56 req-fd53aa73-a69c-4039-b6b5-965fb9c6905e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "392fd03d-b76f-49a4-a965-2bb41b0c011b", "name": "network-vif-deleted", "tag": "b4d49a84-5382-401b-8642-316c0610553c"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:09:55.287046 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-010c4455-dad3-46ff-9ebf-2e7f68f5ef56 req-fd53aa73-a69c-4039-b6b5-965fb9c6905e service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:55.287407 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-010c4455-dad3-46ff-9ebf-2e7f68f5ef56 req-fd53aa73-a69c-4039-b6b5-965fb9c6905e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:55.288164 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-010c4455-dad3-46ff-9ebf-2e7f68f5ef56 req-fd53aa73-a69c-4039-b6b5-965fb9c6905e service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:55.299878 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-010c4455-dad3-46ff-9ebf-2e7f68f5ef56 req-fd53aa73-a69c-4039-b6b5-965fb9c6905e service nova] Creating event network-vif-deleted:b4d49a84-5382-401b-8642-316c0610553c for instance 392fd03d-b76f-49a4-a965-2bb41b0c011b on hv-cinder-83124 Sep 08 20:09:55.305675 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-010c4455-dad3-46ff-9ebf-2e7f68f5ef56 req-fd53aa73-a69c-4039-b6b5-965fb9c6905e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033807 Sep 08 20:09:55.306415 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 550/1130] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:09:56.252760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:56.253369 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:56.260491 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:56.260977 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:56.261404 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:56.262140 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:56.262587 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:56.263047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:56.281163 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] HTTP exception thrown: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Request method failure captured: Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b HTTP/1.1 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkpgd3ji_C4wwYiCGZOIQ2tX6IAml7PbkRO5VOKszafvfpB1UnYxUg95hV-Lv8T56C47aK0t6j65c-5eaQbgoUZV3_DWufbN0fOaA8_yPW7BpmkWJLhzEZ79lq657K1StDU81B4TmR-MWYclKB_3OKKMKnurKMnm9fypQgP2Lj5tiSI Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:09:56.282905 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5600d866afb84f53882c2a5fb07298b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: e582f450b96c4e37ad88501bfa02441e Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:56.284777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '392fd03d-b76f-49a4-a965-2bb41b0c011b'} Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:09:56.290068 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:56.291805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:56.293311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Returning 404 to user: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:09:56.293311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-4dbd62cb-108f-4b3b-a362-3674edfe106f tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 404 len: 111 microversion: 2.20 time: 0.036116 Sep 08 20:09:56.293311 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 581/1131] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:09:56 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:09:56.294527 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-cc81c27c-eff0-439c-8263-ccb7c9e93c65 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '.version_select at 0x7fef84bab790>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:56.318985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-cc81c27c-eff0-439c-8263-ccb7c9e93c65 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101423698" status: 204 len: 0 microversion: 2.20 time: 0.029144 Sep 08 20:09:56.319546 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 551/1132] 10.222.0.44 () {60 vars in 1262 bytes} [Thu Sep 8 20:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101423698 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 20:09:58.084412 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:58.084927 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:58.091850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:58.092340 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:58.092777 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:58.093472 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:58.093930 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:58.094355 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:58.108085 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] HTTP exception thrown: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Request method failure captured: Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b HTTP/1.1 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkpgd3ji_C4wwYiCGZOIQ2tX6IAml7PbkRO5VOKszafvfpB1UnYxUg95hV-Lv8T56C47aK0t6j65c-5eaQbgoUZV3_DWufbN0fOaA8_yPW7BpmkWJLhzEZ79lq657K1StDU81B4TmR-MWYclKB_3OKKMKnurKMnm9fypQgP2Lj5tiSI Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:09:58.109637 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5600d866afb84f53882c2a5fb07298b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: e582f450b96c4e37ad88501bfa02441e Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.111362 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '392fd03d-b76f-49a4-a965-2bb41b0c011b'} Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:09:58.112356 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.114034 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.115494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Returning 404 to user: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:09:58.115494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-30b98a2c-8443-4a73-b285-33402ef878bd tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 404 len: 111 microversion: 2.20 time: 0.030507 Sep 08 20:09:58.115494 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 582/1133] 10.222.0.44 () {60 vars in 1280 bytes} [Thu Sep 8 20:09:58 2022] DELETE /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:09:58.120751 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:58.121485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 392fd03d-b76f-49a4-a965-2bb41b0c011b] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:58.128525 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:58.129013 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:58.129449 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:58.130206 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:58.130763 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:58.131197 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:58.144892 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] HTTP exception thrown: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Request method failure captured: Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b HTTP/1.1 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkpgd3ji_C4wwYiCGZOIQ2tX6IAml7PbkRO5VOKszafvfpB1UnYxUg95hV-Lv8T56C47aK0t6j65c-5eaQbgoUZV3_DWufbN0fOaA8_yPW7BpmkWJLhzEZ79lq657K1StDU81B4TmR-MWYclKB_3OKKMKnurKMnm9fypQgP2Lj5tiSI Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:09:58.146574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5600d866afb84f53882c2a5fb07298b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: e582f450b96c4e37ad88501bfa02441e Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.148351 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '392fd03d-b76f-49a4-a965-2bb41b0c011b'} Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:09:58.149320 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. Sep 08 20:09:58.150963 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:58.152322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Returning 404 to user: Instance 392fd03d-b76f-49a4-a965-2bb41b0c011b could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:09:58.152322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-77833f73-7c53-4ae9-89d3-edec190c52ed tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b" status: 404 len: 111 microversion: 2.20 time: 0.031874 Sep 08 20:09:58.152322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 552/1134] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:09:58 2022] GET /compute/v2.1/servers/392fd03d-b76f-49a4-a965-2bb41b0c011b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:09:59.310505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:59.311075 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:59.317901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:59.318386 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:59.318855 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:59.319549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:59.320000 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:59.320423 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:59.334172 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] HTTP exception thrown: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Request method failure captured: Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 HTTP/1.1 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGkpgd3ji_C4wwYiCGZOIQ2tX6IAml7PbkRO5VOKszafvfpB1UnYxUg95hV-Lv8T56C47aK0t6j65c-5eaQbgoUZV3_DWufbN0fOaA8_yPW7BpmkWJLhzEZ79lq657K1StDU81B4TmR-MWYclKB_3OKKMKnurKMnm9fypQgP2Lj5tiSI Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:09:59.335802 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5600d866afb84f53882c2a5fb07298b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: e582f450b96c4e37ad88501bfa02441e Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.337598 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '16fc41bf-38bc-4704-bebf-b52e1b4f1f48'} Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:09:59.338687 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.340245 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.341881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Returning 404 to user: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:09:59.341881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c51e114e-ab5c-4598-b342-833bc8319cd0 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 404 len: 111 microversion: 2.20 time: 0.030639 Sep 08 20:09:59.341881 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 583/1135] 10.222.0.44 () {60 vars in 1280 bytes} [Thu Sep 8 20:09:59 2022] DELETE /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:09:59.346679 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:09:59.347342 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] [instance: 16fc41bf-38bc-4704-bebf-b52e1b4f1f48] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:09:59.354277 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:59.354791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:59.355228 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:59.355927 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:09:59.356384 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:09:59.356807 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:09:59.370837 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] HTTP exception thrown: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Request method failure captured: Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 HTTP/1.1 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGkpgd3ji_C4wwYiCGZOIQ2tX6IAml7PbkRO5VOKszafvfpB1UnYxUg95hV-Lv8T56C47aK0t6j65c-5eaQbgoUZV3_DWufbN0fOaA8_yPW7BpmkWJLhzEZ79lq657K1StDU81B4TmR-MWYclKB_3OKKMKnurKMnm9fypQgP2Lj5tiSI Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:09:59.372487 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5600d866afb84f53882c2a5fb07298b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5600d866afb84f53882c2a5fb07298b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 5600d866afb84f53882c2a5fb07298b4 Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1210467857 Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: e582f450b96c4e37ad88501bfa02441e Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1210467857-project Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.374506 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '16fc41bf-38bc-4704-bebf-b52e1b4f1f48'} Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:09:59.375650 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. Sep 08 20:09:59.377207 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:09:59.378901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] Returning 404 to user: Instance 16fc41bf-38bc-4704-bebf-b52e1b4f1f48 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:09:59.378901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-fb572cb1-166e-44fd-94cb-0816334652f9 tempest-AttachVolumeShelveTestJSON-1210467857 tempest-AttachVolumeShelveTestJSON-1210467857-project] 10.222.0.44 "GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48" status: 404 len: 111 microversion: 2.20 time: 0.031180 Sep 08 20:09:59.378901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 553/1136] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Sep 8 20:09:59 2022] GET /compute/v2.1/servers/16fc41bf-38bc-4704-bebf-b52e1b4f1f48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 20:11:37.744053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=12 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:37.744884 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=24 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:37.745739 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:11:37.745991 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Thu Sep 8 20:11:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.44) !!! Sep 08 20:11:37.751059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-728277145", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-202422694", "security_groups": [{"name": "tempest-secgroup-smoke-1476250419"}], "block_device_mapping_v2": [{"uuid": "e09b495a-bef0-4c31-bf65-0d56e8e55c59", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "da0828a8-6f51-4654-9c86-6904ed730ff8"}]}} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:11:37.891365 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.network.neutron [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] validate_networks() for [('da0828a8-6f51-4654-9c86-6904ed730ff8', None, None, None, None, None)] {{(pid=120484) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 20:11:38.386357 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Flavor limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 20:11:38.386865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Image limits 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 20:11:38.387441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Flavor pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 20:11:38.387736 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Image pref 0:0:0 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 20:11:38.388147 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.virt.hardware [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120484) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 20:11:38.399396 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:38.399896 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:38.400334 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:38.401060 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:38.401510 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:38.401935 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:38.422336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for project 3020f7128e9e434d82b72b9760db31ba. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 20:11:38.427822 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.quota [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Getting quotas for user cb5ed38c1e2640919b16746d42494d65 and project 3020f7128e9e434d82b72b9760db31ba. Resources: {'instances', 'cores', 'ram'} {{(pid=120484) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 20:11:38.486316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Going to run 1 instances... {{(pid=120484) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 20:11:38.488959 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e09b495a-bef0-4c31-bf65-0d56e8e55c59',volume_size=None,volume_type=None)] {{(pid=120484) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 20:11:38.637833 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-3c7436aa-d1cf-4deb-b160-280bbef424c8 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.895502 Sep 08 20:11:38.638465 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 584/1137] 10.222.0.44 () {60 vars in 1147 bytes} [Thu Sep 8 20:11:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 20:11:38.647989 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6dfceb8b-d607-40ec-9e13-f383f5546ac0] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 20:11:38.648930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:38.649721 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:38.654854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-3356795a-27cd-4bb4-bab9-2b8ba4297099 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:38.656070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-3356795a-27cd-4bb4-bab9-2b8ba4297099 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:38.722960 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-3356795a-27cd-4bb4-bab9-2b8ba4297099 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:38.729930 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-3356795a-27cd-4bb4-bab9-2b8ba4297099 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1093 microversion: 2.1 time: 0.083961 Sep 08 20:11:38.730584 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 554/1138] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:38 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:39.755979 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:39.756812 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:39.763258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:39.763823 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:39.764336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:39.765113 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:39.765618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:39.766053 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:39.871316 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:39.881039 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-6f8b79d2-4087-41f6-861f-b193b7fc5adf tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1191 microversion: 2.1 time: 0.129983 Sep 08 20:11:39.881618 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 585/1139] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:39 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1191 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:40.903792 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:40.904397 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:40.912687 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:40.913148 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:40.913834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:40.914529 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:40.915086 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:40.915427 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:40.921718 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] [6dfceb8b-d607-40ec-9e13-f383f5546ac0] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 45600. Sep 08 20:11:41.053280 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:41.061237 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b809cee1-669a-4313-bdd3-7f30d34e693c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.161357 Sep 08 20:11:41.061812 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 555/1140] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:40 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:41.341536 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-6268afde-99c4-4d0f-aa07-d7cab56e3971 req-d7b9f808-aa0d-4912-b442-a2a191c0b565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e59fefe-0ba4-4a88-9885-260bde45fab3", "tag": "b08b0469-bcd2-4be0-bccd-a9a527da6f77"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:11:41.351295 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6268afde-99c4-4d0f-aa07-d7cab56e3971 req-d7b9f808-aa0d-4912-b442-a2a191c0b565 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:41.351877 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6268afde-99c4-4d0f-aa07-d7cab56e3971 req-d7b9f808-aa0d-4912-b442-a2a191c0b565 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:41.352407 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-6268afde-99c4-4d0f-aa07-d7cab56e3971 req-d7b9f808-aa0d-4912-b442-a2a191c0b565 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:41.364021 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-6268afde-99c4-4d0f-aa07-d7cab56e3971 req-d7b9f808-aa0d-4912-b442-a2a191c0b565 service nova] Creating event network-changed:b08b0469-bcd2-4be0-bccd-a9a527da6f77 for instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 on hv-cinder-83124 Sep 08 20:11:41.369024 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-6268afde-99c4-4d0f-aa07-d7cab56e3971 req-d7b9f808-aa0d-4912-b442-a2a191c0b565 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157554 Sep 08 20:11:41.369641 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 586/1141] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:11:42.088381 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:42.089283 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:42.097603 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:42.098083 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:42.098510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:42.099234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:42.099686 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:42.100109 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:42.232912 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:42.241305 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e2a18369-554b-4279-a61e-d3ad3574b6af tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.159577 Sep 08 20:11:42.241862 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 556/1142] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:42 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:43.272502 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:43.273730 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:43.284101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:43.284898 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:43.285620 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:43.286799 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:43.287551 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:43.288258 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:43.431645 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:43.440165 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-8012bae3-c493-44ca-87e7-97552a241c2c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.175586 Sep 08 20:11:43.440733 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 587/1143] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:43 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:44.466552 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:44.467599 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:44.474745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:44.475226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:44.475671 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:44.476340 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:44.476791 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:44.477204 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:44.606301 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:44.615144 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-0927acf7-e142-4a4d-bc29-e5aa6a62d123 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.155008 Sep 08 20:11:44.615712 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 557/1144] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:44 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:45.641643 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:45.642257 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:45.650240 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:45.650852 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:45.651368 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:45.652184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:45.652722 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:45.653220 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:45.786941 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:45.795254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-094a6ac5-03fd-4254-a73e-185a35a506a5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.160060 Sep 08 20:11:45.795828 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 588/1145] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:45 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:46.829857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:46.830838 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:46.841982 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:46.842857 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:46.843579 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:46.844729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:46.845498 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:46.845921 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:46.981941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:46.994353 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-061e747f-a386-4710-9064-4d35adc12a57 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.171112 Sep 08 20:11:46.995226 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 558/1146] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:46 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:48.023876 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:48.024888 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:48.034532 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:48.035059 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:48.035507 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:48.036209 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:48.036672 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:48.037101 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:48.174090 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:48.186230 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-e266c90d-df7d-438d-be38-4719610ae096 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.168775 Sep 08 20:11:48.187061 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 589/1147] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:48 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:49.211744 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:49.212756 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:49.216642 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell0:SELECT=2 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:49.225652 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:49.226480 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:49.227275 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:49.228428 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:49.229195 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:49.229906 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:49.375112 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:49.383460 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-d892c7be-7db4-43c6-89f2-b0a608e76183 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.177608 Sep 08 20:11:49.383968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 559/1148] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:49 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:50.412029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:50.412975 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:50.415746 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=2 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:50.416440 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell0:SELECT=6 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:11:50.421548 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:50.422029 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:50.422460 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:50.423180 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:50.423629 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:50.424046 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:50.563306 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:50.571538 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-82a1f111-5dd0-4f73-9242-562ea1f567ab tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.164962 Sep 08 20:11:50.572086 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 590/1149] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:50 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:51.598040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:51.598627 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:51.605437 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:51.605927 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:51.606363 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:51.607099 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:51.607559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:51.607985 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:51.745714 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:51.753621 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-2a71700c-dc32-4605-9214-0c1bf010464f tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.161722 Sep 08 20:11:51.754218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 560/1150] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:51 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:52.775924 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:52.776504 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:52.783550 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:52.784200 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:52.784638 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:52.785333 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:52.785785 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:52.786204 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:52.930542 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:52.942674 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-905a8d88-8668-4740-af8d-b791e10bcdb4 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.170404 Sep 08 20:11:52.943481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 591/1151] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:52 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:53.975347 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:53.976289 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:53.987775 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:53.988582 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:53.989318 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:53.990465 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:53.991259 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:53.991964 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:54.147402 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:54.155981 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-484bb06d-4bb4-48e4-b451-c102c2880f4d tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.187340 Sep 08 20:11:54.156562 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 561/1152] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:53 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:55.182945 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:55.183908 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:55.194790 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:55.195594 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:55.196313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:55.197454 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:55.198198 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:55.198963 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:55.332047 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:55.340337 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-00f9b9aa-40b7-4c08-8406-0955e505ee96 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.164133 Sep 08 20:11:55.340901 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 592/1153] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:55 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:56.363968 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:56.364574 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:56.371860 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:56.372360 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:56.372792 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:56.373536 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:56.374049 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:56.374478 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:56.523702 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:56.535646 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-6c866b57-4a68-40c6-8909-898947fb0baa tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.175892 Sep 08 20:11:56.536485 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 562/1154] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:56 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:57.564193 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:57.565331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:57.573184 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:57.573756 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:57.574416 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:57.575229 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:57.575890 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:57.576246 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:57.725481 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:57.733850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-7fbde2ea-5bd8-430d-90ca-7a3dfb0468da tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.177643 Sep 08 20:11:57.734420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 593/1155] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:57 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:58.757583 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:58.758262 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:58.765869 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:58.766414 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:58.766941 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:58.767722 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:58.768230 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:58.768702 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:58.899458 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:11:58.911316 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-ab2426da-850f-4b6d-b69b-18bfa9c825ce tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.157707 Sep 08 20:11:58.911998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 563/1156] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:58 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:11:59.937818 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:11:59.938849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:11:59.947263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:59.947755 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:59.948190 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:11:59.948889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:11:59.949345 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:11:59.949769 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:00.080566 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:00.088729 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-b73c206d-1827-4efe-9b5f-a50e2e6e1770 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.157688 Sep 08 20:12:00.089301 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 594/1157] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:11:59 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:01.112379 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:12:01.112961 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:12:01.120101 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:01.120445 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:01.120867 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:01.121622 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:01.122010 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:01.122438 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:01.251204 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:01.258987 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-7fcedce2-ecc3-42d1-856a-84273fcd2aee tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.150933 Sep 08 20:12:01.259568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 564/1158] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:12:01 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:02.286093 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:12:02.286994 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:12:02.295563 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:02.296162 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:02.296699 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:02.297549 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:02.298109 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:02.298629 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:02.431849 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:02.443350 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-db5e74b0-5488-4b1d-a314-4dc4e7f1aef6 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.163623 Sep 08 20:12:02.444006 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 595/1159] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:12:02 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:03.209871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [req-43ed9f67-4b1e-4516-885a-09faac84499c req-44848bec-d7ab-4909-9862-d52d62852a92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e59fefe-0ba4-4a88-9885-260bde45fab3", "name": "network-vif-plugged", "status": "completed", "tag": "b08b0469-bcd2-4be0-bccd-a9a527da6f77"}]} {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:12:03.219559 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-43ed9f67-4b1e-4516-885a-09faac84499c req-44848bec-d7ab-4909-9862-d52d62852a92 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:03.220042 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-43ed9f67-4b1e-4516-885a-09faac84499c req-44848bec-d7ab-4909-9862-d52d62852a92 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:03.220451 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [req-43ed9f67-4b1e-4516-885a-09faac84499c req-44848bec-d7ab-4909-9862-d52d62852a92 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:03.232235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.compute.server_external_events [req-43ed9f67-4b1e-4516-885a-09faac84499c req-44848bec-d7ab-4909-9862-d52d62852a92 service nova] Creating event network-vif-plugged:b08b0469-bcd2-4be0-bccd-a9a527da6f77 for instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 on hv-cinder-83124 Sep 08 20:12:03.237750 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [req-43ed9f67-4b1e-4516-885a-09faac84499c req-44848bec-d7ab-4909-9862-d52d62852a92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217908 Sep 08 20:12:03.238352 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 565/1160] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:12:03.473916 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:12:03.474574 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:12:03.483708 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:03.484205 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:03.484830 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:03.485757 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:03.486729 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:03.487242 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:03.644515 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:03.652973 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-c49f4139-95d8-4ab2-950f-fb6a14576061 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.183989 Sep 08 20:12:03.653539 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 596/1161] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:12:03 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:04.680009 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:12:04.680706 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:12:04.687578 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:04.688070 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:04.688547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:04.689291 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:04.689785 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:04.690245 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:04.826313 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:04.834537 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-17505791-a6c4-4939-8078-0fe1f59932e0 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1265 microversion: 2.1 time: 0.160687 Sep 08 20:12:04.835150 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 566/1162] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:12:04 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:05.861949 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:12:05.862989 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:12:05.873792 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:05.874595 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:05.875358 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:05.876503 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:05.877254 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:05.877956 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:06.014925 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:06.027108 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-cee4c04a-a6db-45a2-9274-40ae7f5ea91e tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1451 microversion: 2.1 time: 0.171842 Sep 08 20:12:06.027893 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 597/1163] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:12:05 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:06.052385 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:12:06.052986 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:12:06.059821 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:06.060311 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:06.060734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:06.061429 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:06.061880 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:06.062299 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:06.191825 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:12:06.200063 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-b57e5753-0d79-434e-ab96-3446750e40cc tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1451 microversion: 2.1 time: 0.151530 Sep 08 20:12:06.200729 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 567/1164] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:12:06 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:12:08.208010 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-3b2dc1af-02c9-4f22-b15c-a3e434467da7 req-089d0997-4a3b-4033-8a28-5e7197644dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e59fefe-0ba4-4a88-9885-260bde45fab3", "tag": "b08b0469-bcd2-4be0-bccd-a9a527da6f77"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:12:08.213323 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:12:08.218943 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3b2dc1af-02c9-4f22-b15c-a3e434467da7 req-089d0997-4a3b-4033-8a28-5e7197644dbd service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:12:08.219421 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3b2dc1af-02c9-4f22-b15c-a3e434467da7 req-089d0997-4a3b-4033-8a28-5e7197644dbd service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:12:08.219850 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-3b2dc1af-02c9-4f22-b15c-a3e434467da7 req-089d0997-4a3b-4033-8a28-5e7197644dbd service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:12:08.224222 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=77 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:12:08.232577 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-3b2dc1af-02c9-4f22-b15c-a3e434467da7 req-089d0997-4a3b-4033-8a28-5e7197644dbd service nova] Creating event network-changed:b08b0469-bcd2-4be0-bccd-a9a527da6f77 for instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 on hv-cinder-83124 Sep 08 20:12:08.238126 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-3b2dc1af-02c9-4f22-b15c-a3e434467da7 req-089d0997-4a3b-4033-8a28-5e7197644dbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033762 Sep 08 20:12:08.238734 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 598/1165] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:13:58.436854 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_api:SELECT=30 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:13:58.437851 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG dbcounter [-] [120485] Writing DB stats nova_cell1:SELECT=74 {{(pid=120485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:13:58.439071 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:13:58.439319 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 (ip 10.222.0.44) !!! Sep 08 20:13:58.440858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:13:58.440858 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Thu Sep 8 20:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 (ip 10.222.0.44) !!! Sep 08 20:13:58.443482 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b6c50a19-17c1-4d20-a4a4-d91d35bbfd92] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 20:13:58.444740 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_cell1:SELECT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:13:58.446046 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG dbcounter [-] [120484] Writing DB stats nova_api:SELECT=1 {{(pid=120484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 20:13:58.446543 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:13:58.446998 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:13:58.447386 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 20:13:58.447530 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Thu Sep 8 20:13:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Sep 08 20:13:58.456655 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:58.457149 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:58.457616 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:13:58.458321 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:58.458817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:58.459117 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-71e7fbff-6201-462c-a248-e4f0d6065777 req-edc94b4f-6988-4c5e-b626-2c2c3e26cdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e59fefe-0ba4-4a88-9885-260bde45fab3", "tag": "b08b0469-bcd2-4be0-bccd-a9a527da6f77"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:13:58.459510 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:13:58.470693 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-71e7fbff-6201-462c-a248-e4f0d6065777 req-edc94b4f-6988-4c5e-b626-2c2c3e26cdd4 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:58.471825 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-71e7fbff-6201-462c-a248-e4f0d6065777 req-edc94b4f-6988-4c5e-b626-2c2c3e26cdd4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:58.471825 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-71e7fbff-6201-462c-a248-e4f0d6065777 req-edc94b4f-6988-4c5e-b626-2c2c3e26cdd4 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:13:58.483486 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-71e7fbff-6201-462c-a248-e4f0d6065777 req-edc94b4f-6988-4c5e-b626-2c2c3e26cdd4 service nova] Creating event network-changed:b08b0469-bcd2-4be0-bccd-a9a527da6f77 for instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 on hv-cinder-83124 Sep 08 20:13:58.488170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:13:58.488984 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-71e7fbff-6201-462c-a248-e4f0d6065777 req-edc94b4f-6988-4c5e-b626-2c2c3e26cdd4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048804 Sep 08 20:13:58.489589 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 599/1166] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:13:58.572724 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-1cd7ac74-bcff-4ded-bcc2-36e02d19e237 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 204 len: 0 microversion: 2.1 time: 0.137221 Sep 08 20:13:58.577601 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 568/1167] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:13:58 2022] DELETE /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:13:58.582592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:13:58.583336 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:13:58.590505 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:58.591035 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:58.591483 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:13:58.592213 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:58.592700 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:58.593112 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:13:58.942331 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:13:58.948424 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-85fe18a1-f2f4-41ba-93c6-ad34be58efa1 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1575 microversion: 2.1 time: 0.370113 Sep 08 20:13:58.948981 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 600/1168] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:13:58 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1575 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:13:59.982039 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:13:59.983120 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:13:59.994834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:59.995322 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:59.995784 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:13:59.996679 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:13:59.997132 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:13:59.997547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:00.168901 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:14:00.181947 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-e4576640-d751-4d6f-a06d-92b92e18c149 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1575 microversion: 2.1 time: 0.206910 Sep 08 20:14:00.182745 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 569/1169] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:13:59 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:14:00.812390 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-1ad4cc2f-9cec-46fd-8e97-14279c6b3174 req-b4366764-9208-43c7-9157-9f1e8d412f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e59fefe-0ba4-4a88-9885-260bde45fab3", "name": "network-vif-deleted", "tag": "b08b0469-bcd2-4be0-bccd-a9a527da6f77"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:14:00.829418 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO oslo.messaging._drivers.impl_rabbit [-] [b6c50a19-17c1-4d20-a4a4-d91d35bbfd92] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 45790. Sep 08 20:14:00.831731 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-1ad4cc2f-9cec-46fd-8e97-14279c6b3174 req-b4366764-9208-43c7-9157-9f1e8d412f54 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:00.832305 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-1ad4cc2f-9cec-46fd-8e97-14279c6b3174 req-b4366764-9208-43c7-9157-9f1e8d412f54 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:00.832829 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-1ad4cc2f-9cec-46fd-8e97-14279c6b3174 req-b4366764-9208-43c7-9157-9f1e8d412f54 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:00.845592 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-1ad4cc2f-9cec-46fd-8e97-14279c6b3174 req-b4366764-9208-43c7-9157-9f1e8d412f54 service nova] Creating event network-vif-deleted:b08b0469-bcd2-4be0-bccd-a9a527da6f77 for instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 on hv-cinder-83124 Sep 08 20:14:00.850656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-1ad4cc2f-9cec-46fd-8e97-14279c6b3174 req-b4366764-9208-43c7-9157-9f1e8d412f54 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041821 Sep 08 20:14:00.851076 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 601/1170] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:14:01.208734 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:01.209435 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:01.217400 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:01.217902 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:01.218341 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:01.219057 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:01.219758 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:01.220240 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:01.253191 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:01.253651 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:01.254118 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:01.254551 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lazy-loading 'fault' on Instance uuid 2e59fefe-0ba4-4a88-9885-260bde45fab3 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:14:01.295180 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:14:01.303229 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-12891a6d-41f1-43e7-b8d0-07400a39dcb5 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 200 len: 1229 microversion: 2.1 time: 0.098344 Sep 08 20:14:01.303793 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 570/1171] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:01 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:14:02.331677 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:02.332854 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 2e59fefe-0ba4-4a88-9885-260bde45fab3] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:02.340347 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:02.340834 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:02.341269 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:02.341965 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:02.342420 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:02.342889 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:02.356605 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] HTTP exception thrown: Instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 could not be found. Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Request method failure captured: Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 HTTP/1.1 Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGksnGO1UL2uWK58j4DO4TjJmZXa0cbwUSunMAL1mTh-_ekgO6AxuJKNpIMMAr3MOB8UVbY5mEpFsrnjc0VrNSnjX-aNW5K5gHHyBZX4kws3_l2bTc6JBB1L4RdRuFrKV8Smzkc1-GTDySOlNniepLVLLHox2npBp_aV7gyt5F8noDjg Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:14:02.358233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3020f7128e9e434d82b72b9760db31ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: cb5ed38c1e2640919b16746d42494d65 Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 could not be found. Sep 08 20:14:02.360375 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '2e59fefe-0ba4-4a88-9885-260bde45fab3'} Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 could not be found. Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:14:02.361233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 could not be found. Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 could not be found. Sep 08 20:14:02.362962 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:02.364610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Returning 404 to user: Instance 2e59fefe-0ba4-4a88-9885-260bde45fab3 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:14:02.364610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-41c64dc9-9e7b-40a0-8d33-36246616dd92 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3" status: 404 len: 111 microversion: 2.1 time: 0.036214 Sep 08 20:14:02.364610 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 602/1172] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:02 2022] GET /compute/v2.1/servers/2e59fefe-0ba4-4a88-9885-260bde45fab3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:14:05.500817 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:05.501547 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:05.508568 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:05.509160 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:05.509493 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-4bf46044-affc-431e-ab67-22e7ce08b834 req-504b22f0-fba4-417a-b80a-a0594fa44fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "081983ce-7706-40ee-a487-1c9c9d85db41", "tag": "39708969-ad79-416e-8d94-fed3e5377a87"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:14:05.509957 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:05.510430 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:05.510979 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:05.511479 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:05.519773 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-4bf46044-affc-431e-ab67-22e7ce08b834 req-504b22f0-fba4-417a-b80a-a0594fa44fc5 service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:05.520256 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-4bf46044-affc-431e-ab67-22e7ce08b834 req-504b22f0-fba4-417a-b80a-a0594fa44fc5 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:05.520669 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-4bf46044-affc-431e-ab67-22e7ce08b834 req-504b22f0-fba4-417a-b80a-a0594fa44fc5 service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:05.532523 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-4bf46044-affc-431e-ab67-22e7ce08b834 req-504b22f0-fba4-417a-b80a-a0594fa44fc5 service nova] Creating event network-changed:39708969-ad79-416e-8d94-fed3e5377a87 for instance 081983ce-7706-40ee-a487-1c9c9d85db41 on hv-cinder-83124 Sep 08 20:14:05.537656 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-4bf46044-affc-431e-ab67-22e7ce08b834 req-504b22f0-fba4-417a-b80a-a0594fa44fc5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032185 Sep 08 20:14:05.537842 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Going to try to terminate instance {{(pid=120485) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 20:14:05.538569 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 603/1173] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 20:14:05.622074 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-5f394bd4-2791-4fa0-be69-d5fb10111c2b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 204 len: 0 microversion: 2.1 time: 0.124979 Sep 08 20:14:05.624139 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 571/1174] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:14:05 2022] DELETE /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 20:14:05.632134 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:05.633341 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:05.642313 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:05.642920 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:05.643511 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:05.644805 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:05.645300 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:05.646437 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:05.806151 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.policy [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120484) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:14:05.814170 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-73d5edb8-95c3-45da-aae4-ef2991031a3b tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1577 microversion: 2.1 time: 0.186451 Sep 08 20:14:05.814976 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 604/1175] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:05 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:14:06.838047 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:06.838759 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:06.845521 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:06.845974 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:06.846432 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:06.847156 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:06.847606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:06.848025 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:06.981024 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:14:06.989328 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-12b73a80-ecbd-4709-b7c5-46cf4920d551 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1577 microversion: 2.1 time: 0.155655 Sep 08 20:14:06.989909 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 572/1176] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:06 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:14:07.678224 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [req-0a9c22a8-bc62-4e1a-bac8-99189ef0de94 req-c6282b8a-d3a8-4143-b9ab-a61c8eabcd3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "081983ce-7706-40ee-a487-1c9c9d85db41", "name": "network-vif-deleted", "tag": "39708969-ad79-416e-8d94-fed3e5377a87"}]} {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 20:14:07.688360 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-0a9c22a8-bc62-4e1a-bac8-99189ef0de94 req-c6282b8a-d3a8-4143-b9ab-a61c8eabcd3b service nova] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:07.688843 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-0a9c22a8-bc62-4e1a-bac8-99189ef0de94 req-c6282b8a-d3a8-4143-b9ab-a61c8eabcd3b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:07.689322 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [req-0a9c22a8-bc62-4e1a-bac8-99189ef0de94 req-c6282b8a-d3a8-4143-b9ab-a61c8eabcd3b service nova] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:07.701146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.compute.server_external_events [req-0a9c22a8-bc62-4e1a-bac8-99189ef0de94 req-c6282b8a-d3a8-4143-b9ab-a61c8eabcd3b service nova] Creating event network-vif-deleted:39708969-ad79-416e-8d94-fed3e5377a87 for instance 081983ce-7706-40ee-a487-1c9c9d85db41 on hv-cinder-83124 Sep 08 20:14:07.706005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [req-0a9c22a8-bc62-4e1a-bac8-99189ef0de94 req-c6282b8a-d3a8-4143-b9ab-a61c8eabcd3b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031514 Sep 08 20:14:07.706791 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 605/1177] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Sep 8 20:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 20:14:08.012743 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:08.013497 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:08.020834 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:08.021376 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:08.022126 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:08.022908 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:08.023433 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:08.024218 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:08.058795 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:08.059383 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:08.059889 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:08.060405 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.objects.instance [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lazy-loading 'fault' on Instance uuid 081983ce-7706-40ee-a487-1c9c9d85db41 {{(pid=120485) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 20:14:08.104606 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.policy [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5ed38c1e2640919b16746d42494d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3020f7128e9e434d82b72b9760db31ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120485) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 20:14:08.112907 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-27081a0d-7471-4a45-90ee-3b33c3e88c29 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 200 len: 1230 microversion: 2.1 time: 0.104180 Sep 08 20:14:08.113441 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 573/1178] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:08 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 20:14:09.142233 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:09.143324 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 081983ce-7706-40ee-a487-1c9c9d85db41] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:09.154263 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:09.155141 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:09.155867 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:09.157018 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:09.157778 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:09.158489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:09.174857 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] HTTP exception thrown: Instance 081983ce-7706-40ee-a487-1c9c9d85db41 could not be found. Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Request method failure captured: Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 HTTP/1.1 Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGksnGO1UL2uWK58j4DO4TjJmZXa0cbwUSunMAL1mTh-_ekgO6AxuJKNpIMMAr3MOB8UVbY5mEpFsrnjc0VrNSnjX-aNW5K5gHHyBZX4kws3_l2bTc6JBB1L4RdRuFrKV8Smzkc1-GTDySOlNniepLVLLHox2npBp_aV7gyt5F8noDjg Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:14:09.176489 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3020f7128e9e434d82b72b9760db31ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: cb5ed38c1e2640919b16746d42494d65 Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 081983ce-7706-40ee-a487-1c9c9d85db41 could not be found. Sep 08 20:14:09.178145 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '081983ce-7706-40ee-a487-1c9c9d85db41'} Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 081983ce-7706-40ee-a487-1c9c9d85db41 could not be found. Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:14:09.179146 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 081983ce-7706-40ee-a487-1c9c9d85db41 could not be found. Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 081983ce-7706-40ee-a487-1c9c9d85db41 could not be found. Sep 08 20:14:09.180760 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.182303 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Returning 404 to user: Instance 081983ce-7706-40ee-a487-1c9c9d85db41 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:14:09.182303 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-660996d2-f361-4995-b643-c07649452975 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41" status: 404 len: 111 microversion: 2.1 time: 0.043916 Sep 08 20:14:09.182303 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 606/1179] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:09 2022] GET /compute/v2.1/servers/081983ce-7706-40ee-a487-1c9c9d85db41 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:14:09.620040 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:09.620634 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.compute.api [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120485) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:09.627315 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:09.627800 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:09.628235 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:09.628923 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:09.629374 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:09.629794 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG oslo_concurrency.lockutils [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:09.643170 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.wsgi [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] HTTP exception thrown: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Request method failure captured: Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: request: DELETE /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 HTTP/1.1 Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept: application/json Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Accept-Encoding: identity Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Connection: close Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Length: 0 Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Content-Type: application/json Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Host: 10.222.0.44 Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: Openstack-System-Scope: None Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: User-Agent: python-urllib3/1.26.12 Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Auth-Token: gAAAAABjGksnGO1UL2uWK58j4DO4TjJmZXa0cbwUSunMAL1mTh-_ekgO6AxuJKNpIMMAr3MOB8UVbY5mEpFsrnjc0VrNSnjX-aNW5K5gHHyBZX4kws3_l2bTc6JBB1L4RdRuFrKV8Smzkc1-GTDySOlNniepLVLLHox2npBp_aV7gyt5F8noDjg Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Id: None Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Domain-Name: None Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Identity-Status: Confirmed Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Is-Admin-Project: True Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Id: default Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Domain-Name: Default Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Project-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Role: reader,member Sep 08 20:14:09.644816 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Roles: reader,member Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3020f7128e9e434d82b72b9760db31ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-Tenant-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Id: default Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Domain-Name: Default Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Id: cb5ed38c1e2640919b16746d42494d65 Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: X-User-Name: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: method: > Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: exception: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.646500 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: action_args: {'id': '7a5c169e-c871-4979-9342-b3a5c96770a4'} Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:14:09.647554 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.649251 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.651033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Returning 404 to user: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. {{(pid=120485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:14:09.651033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-42c5861f-d8f8-4e23-8d79-06ac4779ee62 tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 404 len: 111 microversion: 2.1 time: 0.030228 Sep 08 20:14:09.651033 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 574/1180] 10.222.0.44 () {58 vars in 1239 bytes} [Thu Sep 8 20:14:09 2022] DELETE /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:14:09.654825 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '>' {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:09.655441 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.compute.api [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] [instance: 7a5c169e-c871-4979-9342-b3a5c96770a4] Fetching instance by UUID {{(pid=120484) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 20:14:09.661519 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:09.662005 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:09.662442 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:09.663168 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Acquiring lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 20:14:09.663626 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 20:14:09.664057 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG oslo_concurrency.lockutils [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Lock "c5aa0669-26cf-4d36-ab88-a2a225f92acd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 20:14:09.677602 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.wsgi [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] HTTP exception thrown: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Request method failure captured: Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: request: GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 HTTP/1.1 Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept: application/json Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Accept-Encoding: identity Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Connection: close Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Length: 0 Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Content-Type: application/json Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Host: 10.222.0.44 Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: Openstack-System-Scope: None Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: User-Agent: python-urllib3/1.26.12 Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Auth-Token: gAAAAABjGksnGO1UL2uWK58j4DO4TjJmZXa0cbwUSunMAL1mTh-_ekgO6AxuJKNpIMMAr3MOB8UVbY5mEpFsrnjc0VrNSnjX-aNW5K5gHHyBZX4kws3_l2bTc6JBB1L4RdRuFrKV8Smzkc1-GTDySOlNniepLVLLHox2npBp_aV7gyt5F8noDjg Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Id: None Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Domain-Name: None Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Identity-Status: Confirmed Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Is-Admin-Project: True Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Id: default Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Domain-Name: Default Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Project-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Role: reader,member Sep 08 20:14:09.679142 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Roles: reader,member Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3020f7128e9e434d82b72b9760db31ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3020f7128e9e434d82b72b9760db31ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Id: 3020f7128e9e434d82b72b9760db31ba Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-Tenant-Name: tempest-TestVolumeBootPattern-496719835 Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Id: default Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Domain-Name: Default Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Id: cb5ed38c1e2640919b16746d42494d65 Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: X-User-Name: tempest-TestVolumeBootPattern-496719835-project Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: method: > Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: exception: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.680913 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: action_args: {'id': '7a5c169e-c871-4979-9342-b3a5c96770a4'} Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: {{(pid=120484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 20:14:09.681865 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. Sep 08 20:14:09.683537 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: ERROR nova.api.openstack.wsgi Sep 08 20:14:09.685009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: DEBUG nova.api.openstack.wsgi [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Returning 404 to user: Instance 7a5c169e-c871-4979-9342-b3a5c96770a4 could not be found. {{(pid=120484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 20:14:09.685009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: INFO nova.api.openstack.requestlog [None req-505d9c83-f3d2-43bd-adec-d474e742d12c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4" status: 404 len: 111 microversion: 2.1 time: 0.029572 Sep 08 20:14:09.685009 dv-cinder-831247-25-iscsi devstack@n-api.service[120484]: [pid: 120484|app: 0|req: 607/1181] 10.222.0.44 () {58 vars in 1236 bytes} [Thu Sep 8 20:14:09 2022] GET /compute/v2.1/servers/7a5c169e-c871-4979-9342-b3a5c96770a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 20:14:10.999871 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: DEBUG nova.api.openstack.wsgi [None req-88a1b7a3-16bc-465c-bc47-132cce077b4c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] Calling method '.version_select at 0x7fef8517daf0>' {{(pid=120485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 20:14:11.026234 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: INFO nova.api.openstack.requestlog [None req-88a1b7a3-16bc-465c-bc47-132cce077b4c tempest-TestVolumeBootPattern-496719835 tempest-TestVolumeBootPattern-496719835-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-202422694" status: 202 len: 0 microversion: 2.1 time: 0.030298 Sep 08 20:14:11.026841 dv-cinder-831247-25-iscsi devstack@n-api.service[120485]: [pid: 120485|app: 0|req: 575/1182] 10.222.0.44 () {58 vars in 1260 bytes} [Thu Sep 8 20:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-202422694 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)